2026-02-13T05:43:15.685 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-13T05:43:15.700 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T05:43:15.776 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47773 branch: wip-bharath17-testing-2026-02-12-0618-tentacle description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/erasure-code} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '47773' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath17-testing-2026-02-12-0618-tentacle ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb workunit: branch: wip-bharath17-testing-2026-02-12-0618-tentacle sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 80 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 2723 sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath17-testing-2026-02-12-0618-tentacle suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb targets: trial024.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBImjD3llrYplNQ2P6rCdPmL1oY3nmAGKp2pSJkiGC4lT0kdT4/rHtPfATYkzo/sAiS5n/28RiCVwSQ8HvRzz6Y8= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - erasure-code teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-13_01:43:11 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T05:43:15.776 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa; will attempt to use it 2026-02-13T05:43:15.776 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa/tasks 2026-02-13T05:43:15.776 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T05:43:15.778 INFO:teuthology.task.internal:Checking packages... 2026-02-13T05:43:15.778 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb' 2026-02-13T05:43:15.778 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T05:43:15.778 INFO:teuthology.packaging:ref: None 2026-02-13T05:43:15.778 INFO:teuthology.packaging:tag: None 2026-02-13T05:43:15.778 INFO:teuthology.packaging:branch: wip-bharath17-testing-2026-02-12-0618-tentacle 2026-02-13T05:43:15.778 INFO:teuthology.packaging:sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T05:43:15.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath17-testing-2026-02-12-0618-tentacle 2026-02-13T05:43:15.901 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-636.g3b40640f 2026-02-13T05:43:15.902 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T05:43:15.914 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T05:43:15.914 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T05:43:15.929 INFO:teuthology.task.internal:Saving configuration 2026-02-13T05:43:15.938 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T05:43:15.950 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T05:43:16.030 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial024.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47773', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 05:40:00.957510', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBImjD3llrYplNQ2P6rCdPmL1oY3nmAGKp2pSJkiGC4lT0kdT4/rHtPfATYkzo/sAiS5n/28RiCVwSQ8HvRzz6Y8='} 2026-02-13T05:43:16.030 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T05:43:16.041 INFO:teuthology.task.internal:roles: ubuntu@trial024.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-13T05:43:16.041 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T05:43:16.127 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7b2d9c684e00>, signals=[15]) 2026-02-13T05:43:16.127 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T05:43:16.138 INFO:teuthology.task.internal:Opening connections... 2026-02-13T05:43:16.138 DEBUG:teuthology.task.internal:connecting to ubuntu@trial024.front.sepia.ceph.com 2026-02-13T05:43:16.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T05:43:16.202 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T05:43:16.216 DEBUG:teuthology.orchestra.run.trial024:> uname -m 2026-02-13T05:43:16.284 INFO:teuthology.orchestra.run.trial024.stdout:x86_64 2026-02-13T05:43:16.284 DEBUG:teuthology.orchestra.run.trial024:> cat /etc/os-release 2026-02-13T05:43:16.339 INFO:teuthology.orchestra.run.trial024.stdout:NAME="CentOS Stream" 2026-02-13T05:43:16.339 INFO:teuthology.orchestra.run.trial024.stdout:VERSION="9" 2026-02-13T05:43:16.339 INFO:teuthology.orchestra.run.trial024.stdout:ID="centos" 2026-02-13T05:43:16.339 INFO:teuthology.orchestra.run.trial024.stdout:ID_LIKE="rhel fedora" 2026-02-13T05:43:16.339 INFO:teuthology.orchestra.run.trial024.stdout:VERSION_ID="9" 2026-02-13T05:43:16.340 INFO:teuthology.orchestra.run.trial024.stdout:PLATFORM_ID="platform:el9" 2026-02-13T05:43:16.340 INFO:teuthology.orchestra.run.trial024.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T05:43:16.340 INFO:teuthology.orchestra.run.trial024.stdout:ANSI_COLOR="0;31" 2026-02-13T05:43:16.340 INFO:teuthology.orchestra.run.trial024.stdout:LOGO="fedora-logo-icon" 2026-02-13T05:43:16.340 INFO:teuthology.orchestra.run.trial024.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T05:43:16.340 INFO:teuthology.orchestra.run.trial024.stdout:HOME_URL="https://centos.org/" 2026-02-13T05:43:16.340 INFO:teuthology.orchestra.run.trial024.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T05:43:16.340 INFO:teuthology.orchestra.run.trial024.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T05:43:16.340 INFO:teuthology.orchestra.run.trial024.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T05:43:16.341 INFO:teuthology.lock.ops:Updating trial024.front.sepia.ceph.com on lock server 2026-02-13T05:43:16.435 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T05:43:16.449 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T05:43:16.461 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T05:43:16.461 DEBUG:teuthology.orchestra.run.trial024:> test '!' -e /home/ubuntu/cephtest 2026-02-13T05:43:16.477 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T05:43:16.489 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T05:43:16.489 DEBUG:teuthology.orchestra.run.trial024:> test -z $(ls -A /var/lib/ceph) 2026-02-13T05:43:16.534 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T05:43:16.638 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T05:43:16.659 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-13T05:43:16.659 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-13T05:43:16.659 DEBUG:teuthology.orchestra.run.trial024:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T05:43:16.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T05:43:16.674 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-13T05:43:16.729 INFO:teuthology.orchestra.run.trial024.stdout:5.14.0-645.el9.x86_64 2026-02-13T05:43:16.729 INFO:teuthology.task.kernel:Running kernel on trial024: 5.14.0-645.el9.x86_64 2026-02-13T05:43:16.729 DEBUG:teuthology.orchestra.run.trial024:> sudo yum install -y kernel 2026-02-13T05:43:25.611 INFO:teuthology.orchestra.run.trial024.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-13T05:43:52.831 INFO:teuthology.orchestra.run.trial024.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 27 MB 00:26 2026-02-13T05:43:56.809 INFO:teuthology.orchestra.run.trial024.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 7.8 MB 00:01 2026-02-13T05:43:57.715 INFO:teuthology.orchestra.run.trial024.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 20 kB 00:00 2026-02-13T05:43:58.232 INFO:teuthology.orchestra.run.trial024.stdout:Extra Packages for Enterprise Linux 46 MB/s | 20 MB 00:00 2026-02-13T05:44:01.476 INFO:teuthology.orchestra.run.trial024.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-13T05:44:02.550 INFO:teuthology.orchestra.run.trial024.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T05:44:02.570 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:44:02.571 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:44:02.571 INFO:teuthology.orchestra.run.trial024.stdout: Package Architecture Version Repository Size 2026-02-13T05:44:02.571 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:44:02.571 INFO:teuthology.orchestra.run.trial024.stdout:Installing: 2026-02-13T05:44:02.571 INFO:teuthology.orchestra.run.trial024.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T05:44:02.571 INFO:teuthology.orchestra.run.trial024.stdout:Installing dependencies: 2026-02-13T05:44:02.572 INFO:teuthology.orchestra.run.trial024.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T05:44:02.572 INFO:teuthology.orchestra.run.trial024.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T05:44:02.572 INFO:teuthology.orchestra.run.trial024.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T05:44:02.572 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:44:02.572 INFO:teuthology.orchestra.run.trial024.stdout:Transaction Summary 2026-02-13T05:44:02.572 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:44:02.572 INFO:teuthology.orchestra.run.trial024.stdout:Install 4 Packages 2026-02-13T05:44:02.572 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:44:02.572 INFO:teuthology.orchestra.run.trial024.stdout:Total download size: 88 M 2026-02-13T05:44:02.572 INFO:teuthology.orchestra.run.trial024.stdout:Installed size: 135 M 2026-02-13T05:44:02.572 INFO:teuthology.orchestra.run.trial024.stdout:Downloading Packages: 2026-02-13T05:44:02.740 INFO:teuthology.orchestra.run.trial024.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 6.7 MB/s | 768 kB 00:00 2026-02-13T05:44:02.823 INFO:teuthology.orchestra.run.trial024.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 88 MB/s | 17 MB 00:00 2026-02-13T05:44:02.893 INFO:teuthology.orchestra.run.trial024.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 201 MB/s | 31 MB 00:00 2026-02-13T05:44:02.952 INFO:teuthology.orchestra.run.trial024.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 122 MB/s | 40 MB 00:00 2026-02-13T05:44:02.952 INFO:teuthology.orchestra.run.trial024.stdout:-------------------------------------------------------------------------------- 2026-02-13T05:44:02.953 INFO:teuthology.orchestra.run.trial024.stdout:Total 231 MB/s | 88 MB 00:00 2026-02-13T05:44:03.141 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction check 2026-02-13T05:44:03.345 INFO:teuthology.orchestra.run.trial024.stdout:Transaction check succeeded. 2026-02-13T05:44:03.345 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction test 2026-02-13T05:44:03.692 INFO:teuthology.orchestra.run.trial024.stdout:Transaction test succeeded. 2026-02-13T05:44:03.692 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction 2026-02-13T05:44:04.780 INFO:teuthology.orchestra.run.trial024.stdout: Preparing : 1/1 2026-02-13T05:44:05.067 INFO:teuthology.orchestra.run.trial024.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T05:44:05.086 INFO:teuthology.orchestra.run.trial024.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T05:44:06.849 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T05:44:06.877 INFO:teuthology.orchestra.run.trial024.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T05:44:09.900 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T05:44:09.907 INFO:teuthology.orchestra.run.trial024.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T05:44:13.005 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T05:44:43.611 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T05:44:43.632 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T05:44:43.697 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T05:44:43.697 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T05:44:43.697 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T05:44:43.697 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T05:44:43.749 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T05:44:43.749 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:44:43.749 INFO:teuthology.orchestra.run.trial024.stdout:Installed: 2026-02-13T05:44:43.749 INFO:teuthology.orchestra.run.trial024.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T05:44:43.749 INFO:teuthology.orchestra.run.trial024.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T05:44:43.749 INFO:teuthology.orchestra.run.trial024.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T05:44:43.750 INFO:teuthology.orchestra.run.trial024.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T05:44:43.750 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:44:43.750 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:44:43.806 DEBUG:teuthology.orchestra.run.trial024:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T05:44:43.832 INFO:teuthology.orchestra.run.trial024.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T05:44:43.832 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T05:44:43.832 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T05:44:43.832 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T05:44:43.832 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T05:44:43.832 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-13T05:44:43.832 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial024.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T05:44:43.832 DEBUG:teuthology.orchestra.run.trial024:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T05:44:43.895 INFO:teuthology.orchestra.run.trial024.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T05:44:43.896 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T05:44:43.896 DEBUG:teuthology.orchestra.run.trial024:> sudo rpm -qi grub2-tools 2026-02-13T05:44:43.963 INFO:teuthology.orchestra.run.trial024.stdout:Name : grub2-tools 2026-02-13T05:44:43.963 INFO:teuthology.orchestra.run.trial024.stdout:Epoch : 1 2026-02-13T05:44:43.963 INFO:teuthology.orchestra.run.trial024.stdout:Version : 2.06 2026-02-13T05:44:43.963 INFO:teuthology.orchestra.run.trial024.stdout:Release : 118.el9 2026-02-13T05:44:43.963 INFO:teuthology.orchestra.run.trial024.stdout:Architecture: x86_64 2026-02-13T05:44:43.963 INFO:teuthology.orchestra.run.trial024.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T05:44:43.963 INFO:teuthology.orchestra.run.trial024.stdout:Group : Unspecified 2026-02-13T05:44:43.963 INFO:teuthology.orchestra.run.trial024.stdout:Size : 8393909 2026-02-13T05:44:43.963 INFO:teuthology.orchestra.run.trial024.stdout:License : GPLv3+ 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:Packager : builder@centos.org 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:Vendor : CentOS 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:Summary : Support tools for GRUB. 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:Description : 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:hardware devices. 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:44:43.964 INFO:teuthology.orchestra.run.trial024.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T05:44:43.965 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T05:44:43.965 INFO:teuthology.task.kernel:Updating grub on trial024 to boot 5.14.0-677.el9.x86_64 2026-02-13T05:44:43.965 DEBUG:teuthology.orchestra.run.trial024:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T05:44:44.029 INFO:teuthology.orchestra.run.trial024.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T05:44:44.030 DEBUG:teuthology.orchestra.run.trial024:> sudo command -v grubby && echo yes || echo no 2026-02-13T05:44:44.092 INFO:teuthology.orchestra.run.trial024.stdout:/sbin/grubby 2026-02-13T05:44:44.093 INFO:teuthology.orchestra.run.trial024.stdout:yes 2026-02-13T05:44:44.093 DEBUG:teuthology.orchestra.run.trial024:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T05:44:44.157 INFO:teuthology.orchestra.run.trial024.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T05:44:44.157 DEBUG:teuthology.orchestra.run.trial024:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T05:44:44.230 DEBUG:teuthology.orchestra.run.trial024:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T05:44:44.440 INFO:teuthology.orchestra.run.trial024.stderr:Generating grub configuration file ... 2026-02-13T05:44:44.503 INFO:teuthology.orchestra.run.trial024.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T05:44:44.510 INFO:teuthology.orchestra.run.trial024.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T05:44:44.763 INFO:teuthology.orchestra.run.trial024.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T05:44:44.770 INFO:teuthology.orchestra.run.trial024.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T05:44:44.801 INFO:teuthology.orchestra.run.trial024.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T05:44:44.808 INFO:teuthology.orchestra.run.trial024.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T05:44:44.830 INFO:teuthology.orchestra.run.trial024.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T05:44:44.837 INFO:teuthology.orchestra.run.trial024.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T05:44:44.920 INFO:teuthology.orchestra.run.trial024.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T05:44:44.928 INFO:teuthology.orchestra.run.trial024.stderr:done 2026-02-13T05:44:44.930 DEBUG:teuthology.orchestra.run.trial024:> test -d /sys/firmware/efi 2026-02-13T05:44:44.945 DEBUG:teuthology.orchestra.run.trial024:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T05:44:45.010 INFO:teuthology.orchestra.run.trial024.stdout:/boot/efi/EFI/BOOT 2026-02-13T05:44:45.010 INFO:teuthology.orchestra.run.trial024.stdout:/boot/efi/EFI/centos 2026-02-13T05:44:45.011 DEBUG:teuthology.orchestra.run.trial024:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T05:44:45.078 INFO:teuthology.orchestra.run.trial024.stdout:no 2026-02-13T05:44:45.078 DEBUG:teuthology.orchestra.run.trial024:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T05:44:45.143 INFO:teuthology.orchestra.run.trial024.stdout:yes 2026-02-13T05:44:45.143 DEBUG:teuthology.orchestra.run.trial024:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T05:44:45.206 DEBUG:teuthology.orchestra.run.trial024:> sudo shutdown -r now 2026-02-13T05:44:45.278 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-13T05:45:15.278 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-13T05:45:15.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-13T05:45:15.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T05:46:15.302 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T05:46:24.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-13T05:46:24.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T05:46:24.443 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-13T05:46:24.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-13T05:46:24.605 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-13T05:46:24.605 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-13T05:46:24.661 INFO:teuthology.orchestra.run.trial024.stdout:5.14.0-677.el9.x86_64 2026-02-13T05:46:24.661 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T05:46:24.661 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T05:46:24.661 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T05:46:25.662 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-13T05:46:25.663 DEBUG:teuthology.orchestra.run.trial024:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-13T05:46:25.692 INFO:teuthology.orchestra.run.trial024.stdout:ttyS1 2026-02-13T05:46:25.713 DEBUG:teuthology.parallel:result is None 2026-02-13T05:46:25.713 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T05:46:25.725 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T05:46:25.725 DEBUG:teuthology.orchestra.run.trial024:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T05:46:25.771 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T05:46:25.783 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T05:46:25.799 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T05:46:25.800 DEBUG:teuthology.orchestra.run.trial024:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T05:46:25.833 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T05:46:25.845 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T05:46:25.845 DEBUG:teuthology.orchestra.run.trial024:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T05:46:25.893 INFO:teuthology.orchestra.run.trial024.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:46:25.901 INFO:teuthology.orchestra.run.trial024.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:46:25.903 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T05:46:25.915 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T05:46:25.915 DEBUG:teuthology.orchestra.run.trial024:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T05:46:25.969 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T05:46:25.986 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T05:46:25.986 DEBUG:teuthology.orchestra.run.trial024:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T05:46:26.025 DEBUG:teuthology.orchestra.run.trial024:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T05:46:26.185 DEBUG:teuthology.orchestra.run.trial024:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T05:46:26.210 DEBUG:teuthology.orchestra.run.trial024:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T05:46:26.322 DEBUG:teuthology.orchestra.run.trial024:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T05:46:26.347 DEBUG:teuthology.orchestra.run.trial024:> set -ex 2026-02-13T05:46:26.347 DEBUG:teuthology.orchestra.run.trial024:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T05:46:26.410 DEBUG:teuthology.orchestra.run.trial024:> sudo service rsyslog restart 2026-02-13T05:46:26.477 INFO:teuthology.orchestra.run.trial024.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T05:46:26.870 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T05:46:26.881 INFO:teuthology.task.internal:Starting timer... 2026-02-13T05:46:26.882 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T05:46:26.897 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T05:46:26.910 DEBUG:teuthology.orchestra.run.trial024:> sudo service auditd rotate 2026-02-13T05:46:26.937 INFO:teuthology.orchestra.run.trial024.stdout:Rotating logs: 2026-02-13T05:46:26.938 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T05:46:26.938 DEBUG:teuthology.orchestra.run.trial024:> /usr/sbin/getenforce 2026-02-13T05:46:26.993 INFO:teuthology.orchestra.run.trial024.stdout:Permissive 2026-02-13T05:46:26.994 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial024.front.sepia.ceph.com': 'permissive'} 2026-02-13T05:46:26.994 DEBUG:teuthology.orchestra.run.trial024:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-13T05:46:27.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T05:46:27.058 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T05:46:27.058 DEBUG:teuthology.orchestra.run.trial024:> sudo /usr/sbin/setenforce permissive 2026-02-13T05:46:27.121 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T05:46:27.134 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T05:46:27.146 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T05:46:27.147 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial024.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T05:47:39.376 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial024.front.sepia.ceph.com')] 2026-02-13T05:47:39.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-13T05:47:39.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T05:47:39.487 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-13T05:47:39.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-13T05:47:39.560 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T05:47:39.574 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T05:47:39.574 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T05:47:39.574 DEBUG:teuthology.orchestra.run.trial024:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T05:47:39.628 INFO:teuthology.orchestra.run.trial024.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T05:47:39.640 INFO:teuthology.orchestra.run.trial024.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T05:47:39.659 INFO:teuthology.orchestra.run.trial024.stderr:sudo: ntpd: command not found 2026-02-13T05:47:39.668 INFO:teuthology.orchestra.run.trial024.stdout:506 Cannot talk to daemon 2026-02-13T05:47:39.680 INFO:teuthology.orchestra.run.trial024.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T05:47:39.691 INFO:teuthology.orchestra.run.trial024.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T05:47:39.736 INFO:teuthology.orchestra.run.trial024.stderr:bash: line 1: ntpq: command not found 2026-02-13T05:47:39.737 INFO:teuthology.orchestra.run.trial024.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T05:47:39.737 INFO:teuthology.orchestra.run.trial024.stdout:=============================================================================== 2026-02-13T05:47:39.738 INFO:teuthology.run_tasks:Running task install... 2026-02-13T05:47:39.756 DEBUG:teuthology.task.install:project ceph 2026-02-13T05:47:39.756 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb'}} 2026-02-13T05:47:39.756 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb'} 2026-02-13T05:47:39.756 INFO:teuthology.task.install:Using flavor: default 2026-02-13T05:47:39.764 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T05:47:39.765 INFO:teuthology.task.install:extra packages: [] 2026-02-13T05:47:39.765 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb', 'tag': None, 'wait_for_package': False} 2026-02-13T05:47:39.766 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T05:47:39.925 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/centos/9/flavors/default/ 2026-02-13T05:47:39.925 INFO:teuthology.task.install.rpm:Package version is 20.2.0-636.g3b40640f 2026-02-13T05:47:40.222 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T05:47:40.222 DEBUG:teuthology.orchestra.run.trial024:> set -ex 2026-02-13T05:47:40.222 DEBUG:teuthology.orchestra.run.trial024:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T05:47:40.248 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-13T05:47:40.248 DEBUG:teuthology.orchestra.run.trial024:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T05:47:40.313 DEBUG:teuthology.orchestra.run.trial024:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T05:47:40.387 DEBUG:teuthology.orchestra.run.trial024:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T05:47:40.451 INFO:teuthology.orchestra.run.trial024.stdout:check_obsoletes = 1 2026-02-13T05:47:40.452 DEBUG:teuthology.orchestra.run.trial024:> sudo yum clean all 2026-02-13T05:47:40.600 INFO:teuthology.orchestra.run.trial024.stdout:41 files removed 2026-02-13T05:47:40.613 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install ceph-radosgw 2026-02-13T05:47:41.265 INFO:teuthology.orchestra.run.trial024.stdout:ceph packages for x86_64 174 kB/s | 89 kB 00:00 2026-02-13T05:47:41.741 INFO:teuthology.orchestra.run.trial024.stdout:ceph noarch packages 41 kB/s | 19 kB 00:00 2026-02-13T05:47:42.170 INFO:teuthology.orchestra.run.trial024.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2026-02-13T05:47:43.030 INFO:teuthology.orchestra.run.trial024.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-13T05:47:46.082 INFO:teuthology.orchestra.run.trial024.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-13T05:47:56.849 INFO:teuthology.orchestra.run.trial024.stdout:CentOS Stream 9 - CRB 943 kB/s | 7.8 MB 00:08 2026-02-13T05:47:57.937 INFO:teuthology.orchestra.run.trial024.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 20 kB 00:00 2026-02-13T05:47:59.057 INFO:teuthology.orchestra.run.trial024.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-13T05:48:02.297 INFO:teuthology.orchestra.run.trial024.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-13T05:48:03.591 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:03.592 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:03.592 INFO:teuthology.orchestra.run.trial024.stdout: Package Arch Version Repository Size 2026-02-13T05:48:03.592 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:03.593 INFO:teuthology.orchestra.run.trial024.stdout:Installing: 2026-02-13T05:48:03.593 INFO:teuthology.orchestra.run.trial024.stdout: ceph-radosgw x86_64 2:20.2.0-636.g3b40640f.el9 ceph 24 M 2026-02-13T05:48:03.593 INFO:teuthology.orchestra.run.trial024.stdout:Upgrading: 2026-02-13T05:48:03.593 INFO:teuthology.orchestra.run.trial024.stdout: librados2 x86_64 2:20.2.0-636.g3b40640f.el9 ceph 3.5 M 2026-02-13T05:48:03.593 INFO:teuthology.orchestra.run.trial024.stdout: librbd1 x86_64 2:20.2.0-636.g3b40640f.el9 ceph 2.8 M 2026-02-13T05:48:03.593 INFO:teuthology.orchestra.run.trial024.stdout:Installing dependencies: 2026-02-13T05:48:03.593 INFO:teuthology.orchestra.run.trial024.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T05:48:03.593 INFO:teuthology.orchestra.run.trial024.stdout: ceph-base x86_64 2:20.2.0-636.g3b40640f.el9 ceph 5.9 M 2026-02-13T05:48:03.593 INFO:teuthology.orchestra.run.trial024.stdout: ceph-common x86_64 2:20.2.0-636.g3b40640f.el9 ceph 24 M 2026-02-13T05:48:03.593 INFO:teuthology.orchestra.run.trial024.stdout: ceph-selinux x86_64 2:20.2.0-636.g3b40640f.el9 ceph 25 k 2026-02-13T05:48:03.593 INFO:teuthology.orchestra.run.trial024.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: libcephfs2 x86_64 2:20.2.0-636.g3b40640f.el9 ceph 870 k 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: libradosstriper1 x86_64 2:20.2.0-636.g3b40640f.el9 ceph 249 k 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: librgw2 x86_64 2:20.2.0-636.g3b40640f.el9 ceph 6.4 M 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T05:48:03.594 INFO:teuthology.orchestra.run.trial024.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T05:48:03.595 INFO:teuthology.orchestra.run.trial024.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T05:48:03.595 INFO:teuthology.orchestra.run.trial024.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T05:48:03.595 INFO:teuthology.orchestra.run.trial024.stdout: python3-ceph-argparse x86_64 2:20.2.0-636.g3b40640f.el9 ceph 45 k 2026-02-13T05:48:03.595 INFO:teuthology.orchestra.run.trial024.stdout: python3-ceph-common x86_64 2:20.2.0-636.g3b40640f.el9 ceph 175 k 2026-02-13T05:48:03.595 INFO:teuthology.orchestra.run.trial024.stdout: python3-cephfs x86_64 2:20.2.0-636.g3b40640f.el9 ceph 163 k 2026-02-13T05:48:03.595 INFO:teuthology.orchestra.run.trial024.stdout: python3-rados x86_64 2:20.2.0-636.g3b40640f.el9 ceph 324 k 2026-02-13T05:48:03.595 INFO:teuthology.orchestra.run.trial024.stdout: python3-rbd x86_64 2:20.2.0-636.g3b40640f.el9 ceph 306 k 2026-02-13T05:48:03.595 INFO:teuthology.orchestra.run.trial024.stdout: python3-rgw x86_64 2:20.2.0-636.g3b40640f.el9 ceph 99 k 2026-02-13T05:48:03.595 INFO:teuthology.orchestra.run.trial024.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T05:48:03.595 INFO:teuthology.orchestra.run.trial024.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T05:48:03.595 INFO:teuthology.orchestra.run.trial024.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T05:48:03.595 INFO:teuthology.orchestra.run.trial024.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T05:48:03.596 INFO:teuthology.orchestra.run.trial024.stdout:Installing weak dependencies: 2026-02-13T05:48:03.596 INFO:teuthology.orchestra.run.trial024.stdout: libcephfs-daemon x86_64 2:20.2.0-636.g3b40640f.el9 ceph 35 k 2026-02-13T05:48:03.596 INFO:teuthology.orchestra.run.trial024.stdout: libcephfs-proxy2 x86_64 2:20.2.0-636.g3b40640f.el9 ceph 24 k 2026-02-13T05:48:03.596 INFO:teuthology.orchestra.run.trial024.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-13T05:48:03.596 INFO:teuthology.orchestra.run.trial024.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T05:48:03.596 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:03.596 INFO:teuthology.orchestra.run.trial024.stdout:Transaction Summary 2026-02-13T05:48:03.596 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:03.596 INFO:teuthology.orchestra.run.trial024.stdout:Install 35 Packages 2026-02-13T05:48:03.596 INFO:teuthology.orchestra.run.trial024.stdout:Upgrade 2 Packages 2026-02-13T05:48:03.596 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:03.597 INFO:teuthology.orchestra.run.trial024.stdout:Total download size: 79 M 2026-02-13T05:48:03.597 INFO:teuthology.orchestra.run.trial024.stdout:Downloading Packages: 2026-02-13T05:48:05.123 INFO:teuthology.orchestra.run.trial024.stdout:(1/37): ceph-common-20.2.0-636.g3b40640f.el9.x8 18 MB/s | 24 MB 00:01 2026-02-13T05:48:05.170 INFO:teuthology.orchestra.run.trial024.stdout:(2/37): ceph-selinux-20.2.0-636.g3b40640f.el9.x 535 kB/s | 25 kB 00:00 2026-02-13T05:48:05.211 INFO:teuthology.orchestra.run.trial024.stdout:(3/37): libcephfs-daemon-20.2.0-636.g3b40640f.e 875 kB/s | 35 kB 00:00 2026-02-13T05:48:05.280 INFO:teuthology.orchestra.run.trial024.stdout:(4/37): ceph-radosgw-20.2.0-636.g3b40640f.el9.x 16 MB/s | 24 MB 00:01 2026-02-13T05:48:05.280 INFO:teuthology.orchestra.run.trial024.stdout:(5/37): libcephfs-proxy2-20.2.0-636.g3b40640f.e 347 kB/s | 24 kB 00:00 2026-02-13T05:48:05.327 INFO:teuthology.orchestra.run.trial024.stdout:(6/37): libcephfs2-20.2.0-636.g3b40640f.el9.x86 18 MB/s | 870 kB 00:00 2026-02-13T05:48:05.330 INFO:teuthology.orchestra.run.trial024.stdout:(7/37): libradosstriper1-20.2.0-636.g3b40640f.e 4.9 MB/s | 249 kB 00:00 2026-02-13T05:48:05.372 INFO:teuthology.orchestra.run.trial024.stdout:(8/37): python3-ceph-argparse-20.2.0-636.g3b406 1.1 MB/s | 45 kB 00:00 2026-02-13T05:48:05.415 INFO:teuthology.orchestra.run.trial024.stdout:(9/37): python3-ceph-common-20.2.0-636.g3b40640 4.0 MB/s | 175 kB 00:00 2026-02-13T05:48:05.457 INFO:teuthology.orchestra.run.trial024.stdout:(10/37): python3-cephfs-20.2.0-636.g3b40640f.el 3.8 MB/s | 163 kB 00:00 2026-02-13T05:48:05.500 INFO:teuthology.orchestra.run.trial024.stdout:(11/37): python3-rados-20.2.0-636.g3b40640f.el9 7.3 MB/s | 324 kB 00:00 2026-02-13T05:48:05.543 INFO:teuthology.orchestra.run.trial024.stdout:(12/37): python3-rbd-20.2.0-636.g3b40640f.el9.x 6.9 MB/s | 306 kB 00:00 2026-02-13T05:48:05.586 INFO:teuthology.orchestra.run.trial024.stdout:(13/37): python3-rgw-20.2.0-636.g3b40640f.el9.x 2.3 MB/s | 99 kB 00:00 2026-02-13T05:48:05.621 INFO:teuthology.orchestra.run.trial024.stdout:(14/37): librgw2-20.2.0-636.g3b40640f.el9.x86_6 22 MB/s | 6.4 MB 00:00 2026-02-13T05:48:05.994 INFO:teuthology.orchestra.run.trial024.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 81 kB/s | 33 kB 00:00 2026-02-13T05:48:06.196 INFO:teuthology.orchestra.run.trial024.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 462 kB/s | 93 kB 00:00 2026-02-13T05:48:06.834 INFO:teuthology.orchestra.run.trial024.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 163 kB/s | 104 kB 00:00 2026-02-13T05:48:07.149 INFO:teuthology.orchestra.run.trial024.stdout:(18/37): ceph-base-20.2.0-636.g3b40640f.el9.x86 1.8 MB/s | 5.9 MB 00:03 2026-02-13T05:48:07.266 INFO:teuthology.orchestra.run.trial024.stdout:(19/37): nvme-cli-2.13-1.el9.x86_64.rpm 683 kB/s | 1.1 MB 00:01 2026-02-13T05:48:07.522 INFO:teuthology.orchestra.run.trial024.stdout:(20/37): libnbd-1.20.3-4.el9.x86_64.rpm 238 kB/s | 164 kB 00:00 2026-02-13T05:48:07.820 INFO:teuthology.orchestra.run.trial024.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 82 kB/s | 45 kB 00:00 2026-02-13T05:48:07.833 INFO:teuthology.orchestra.run.trial024.stdout:(22/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 234 kB/s | 160 kB 00:00 2026-02-13T05:48:08.356 INFO:teuthology.orchestra.run.trial024.stdout:(23/37): librdkafka-1.6.1-102.el9.x86_64.rpm 794 kB/s | 662 kB 00:00 2026-02-13T05:48:08.557 INFO:teuthology.orchestra.run.trial024.stdout:(24/37): qatlib-25.08.0-2.el9.x86_64.rpm 331 kB/s | 240 kB 00:00 2026-02-13T05:48:08.565 INFO:teuthology.orchestra.run.trial024.stdout:(25/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 392 kB/s | 292 kB 00:00 2026-02-13T05:48:08.627 INFO:teuthology.orchestra.run.trial024.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.9 MB/s | 308 kB 00:00 2026-02-13T05:48:08.687 INFO:teuthology.orchestra.run.trial024.stdout:(27/37): libarrow-9.0.0-15.el9.x86_64.rpm 73 MB/s | 4.4 MB 00:00 2026-02-13T05:48:08.697 INFO:teuthology.orchestra.run.trial024.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 2.5 MB/s | 25 kB 00:00 2026-02-13T05:48:08.707 INFO:teuthology.orchestra.run.trial024.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 4.9 MB/s | 49 kB 00:00 2026-02-13T05:48:08.717 INFO:teuthology.orchestra.run.trial024.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 6.6 MB/s | 67 kB 00:00 2026-02-13T05:48:08.748 INFO:teuthology.orchestra.run.trial024.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 26 MB/s | 838 kB 00:00 2026-02-13T05:48:08.759 INFO:teuthology.orchestra.run.trial024.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 17 MB/s | 191 kB 00:00 2026-02-13T05:48:08.804 INFO:teuthology.orchestra.run.trial024.stdout:(33/37): thrift-0.15.0-4.el9.x86_64.rpm 36 MB/s | 1.6 MB 00:00 2026-02-13T05:48:08.901 INFO:teuthology.orchestra.run.trial024.stdout:(34/37): qatlib-service-25.08.0-2.el9.x86_64.rp 68 kB/s | 37 kB 00:00 2026-02-13T05:48:09.110 INFO:teuthology.orchestra.run.trial024.stdout:(35/37): librbd1-20.2.0-636.g3b40640f.el9.x86_6 14 MB/s | 2.8 MB 00:00 2026-02-13T05:48:09.152 INFO:teuthology.orchestra.run.trial024.stdout:(36/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 111 kB/s | 66 kB 00:00 2026-02-13T05:48:09.289 INFO:teuthology.orchestra.run.trial024.stdout:(37/37): librados2-20.2.0-636.g3b40640f.el9.x86 7.2 MB/s | 3.5 MB 00:00 2026-02-13T05:48:09.292 INFO:teuthology.orchestra.run.trial024.stdout:-------------------------------------------------------------------------------- 2026-02-13T05:48:09.292 INFO:teuthology.orchestra.run.trial024.stdout:Total 14 MB/s | 79 MB 00:05 2026-02-13T05:48:09.385 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction check 2026-02-13T05:48:09.404 INFO:teuthology.orchestra.run.trial024.stdout:Transaction check succeeded. 2026-02-13T05:48:09.404 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction test 2026-02-13T05:48:09.703 INFO:teuthology.orchestra.run.trial024.stdout:Transaction test succeeded. 2026-02-13T05:48:09.703 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction 2026-02-13T05:48:10.046 INFO:teuthology.orchestra.run.trial024.stdout: Preparing : 1/1 2026-02-13T05:48:10.058 INFO:teuthology.orchestra.run.trial024.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-13T05:48:10.219 INFO:teuthology.orchestra.run.trial024.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-13T05:48:10.224 INFO:teuthology.orchestra.run.trial024.stdout: Upgrading : librados2-2:20.2.0-636.g3b40640f.el9.x86_64 3/39 2026-02-13T05:48:10.275 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: librados2-2:20.2.0-636.g3b40640f.el9.x86_64 3/39 2026-02-13T05:48:10.276 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libcephfs2-2:20.2.0-636.g3b40640f.el9.x86_64 4/39 2026-02-13T05:48:10.289 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: libcephfs2-2:20.2.0-636.g3b40640f.el9.x86_64 4/39 2026-02-13T05:48:10.291 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libcephfs-daemon-2:20.2.0-636.g3b40640f.el9.x86_64 5/39 2026-02-13T05:48:10.292 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libcephfs-proxy2-2:20.2.0-636.g3b40640f.el9.x86_64 6/39 2026-02-13T05:48:10.320 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-636.g3b40640f.el9.x86_64 6/39 2026-02-13T05:48:10.322 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-rados-2:20.2.0-636.g3b40640f.el9.x86_64 7/39 2026-02-13T05:48:10.331 INFO:teuthology.orchestra.run.trial024.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-13T05:48:10.333 INFO:teuthology.orchestra.run.trial024.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-13T05:48:10.337 INFO:teuthology.orchestra.run.trial024.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-13T05:48:10.341 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-13T05:48:10.350 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-ceph-argparse-2:20.2.0-636.g3b40640f.el9.x 12/39 2026-02-13T05:48:10.362 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-cephfs-2:20.2.0-636.g3b40640f.el9.x86_64 13/39 2026-02-13T05:48:10.363 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libradosstriper1-2:20.2.0-636.g3b40640f.el9.x86_64 14/39 2026-02-13T05:48:10.376 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: libradosstriper1-2:20.2.0-636.g3b40640f.el9.x86_64 14/39 2026-02-13T05:48:10.408 INFO:teuthology.orchestra.run.trial024.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-13T05:48:10.413 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-13T05:48:10.419 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-13T05:48:10.421 INFO:teuthology.orchestra.run.trial024.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-13T05:48:10.426 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-13T05:48:10.552 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-13T05:48:10.554 INFO:teuthology.orchestra.run.trial024.stdout: Upgrading : librbd1-2:20.2.0-636.g3b40640f.el9.x86_64 21/39 2026-02-13T05:48:10.580 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: librbd1-2:20.2.0-636.g3b40640f.el9.x86_64 21/39 2026-02-13T05:48:10.583 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-rbd-2:20.2.0-636.g3b40640f.el9.x86_64 22/39 2026-02-13T05:48:10.589 INFO:teuthology.orchestra.run.trial024.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-13T05:48:10.877 INFO:teuthology.orchestra.run.trial024.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-13T05:48:10.878 INFO:teuthology.orchestra.run.trial024.stdout: Installing : librgw2-2:20.2.0-636.g3b40640f.el9.x86_64 25/39 2026-02-13T05:48:10.894 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: librgw2-2:20.2.0-636.g3b40640f.el9.x86_64 25/39 2026-02-13T05:48:10.897 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-rgw-2:20.2.0-636.g3b40640f.el9.x86_64 26/39 2026-02-13T05:48:10.903 INFO:teuthology.orchestra.run.trial024.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-13T05:48:10.906 INFO:teuthology.orchestra.run.trial024.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-13T05:48:10.906 INFO:teuthology.orchestra.run.trial024.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-13T05:48:10.924 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-13T05:48:11.038 INFO:teuthology.orchestra.run.trial024.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-13T05:48:11.040 INFO:teuthology.orchestra.run.trial024.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-13T05:48:11.322 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-13T05:48:11.322 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T05:48:11.322 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:11.363 INFO:teuthology.orchestra.run.trial024.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-13T05:48:11.365 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-ceph-common-2:20.2.0-636.g3b40640f.el9.x86 33/39 2026-02-13T05:48:12.481 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-common-2:20.2.0-636.g3b40640f.el9.x86_64 34/39 2026-02-13T05:48:12.484 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-common-2:20.2.0-636.g3b40640f.el9.x86_64 34/39 2026-02-13T05:48:12.786 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-common-2:20.2.0-636.g3b40640f.el9.x86_64 34/39 2026-02-13T05:48:12.789 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-base-2:20.2.0-636.g3b40640f.el9.x86_64 35/39 2026-02-13T05:48:12.826 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-base-2:20.2.0-636.g3b40640f.el9.x86_64 35/39 2026-02-13T05:48:12.826 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T05:48:12.826 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T05:48:12.826 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:12.830 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-selinux-2:20.2.0-636.g3b40640f.el9.x86_64 36/39 2026-02-13T05:48:17.384 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-selinux-2:20.2.0-636.g3b40640f.el9.x86_64 36/39 2026-02-13T05:48:17.384 INFO:teuthology.orchestra.run.trial024.stdout:skipping the directory /sys 2026-02-13T05:48:17.384 INFO:teuthology.orchestra.run.trial024.stdout:skipping the directory /proc 2026-02-13T05:48:17.384 INFO:teuthology.orchestra.run.trial024.stdout:skipping the directory /mnt 2026-02-13T05:48:17.384 INFO:teuthology.orchestra.run.trial024.stdout:skipping the directory /var/tmp 2026-02-13T05:48:17.385 INFO:teuthology.orchestra.run.trial024.stdout:skipping the directory /home 2026-02-13T05:48:17.385 INFO:teuthology.orchestra.run.trial024.stdout:skipping the directory /root 2026-02-13T05:48:17.385 INFO:teuthology.orchestra.run.trial024.stdout:skipping the directory /tmp 2026-02-13T05:48:17.385 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:18.456 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-radosgw-2:20.2.0-636.g3b40640f.el9.x86_64 37/39 2026-02-13T05:48:18.479 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-636.g3b40640f.el9.x86_64 37/39 2026-02-13T05:48:18.479 INFO:teuthology.orchestra.run.trial024.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T05:48:18.479 INFO:teuthology.orchestra.run.trial024.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T05:48:18.479 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T05:48:18.479 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T05:48:18.479 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:18.481 INFO:teuthology.orchestra.run.trial024.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-13T05:48:18.492 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-13T05:48:18.493 INFO:teuthology.orchestra.run.trial024.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-13T05:48:18.548 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-13T05:48:18.548 INFO:teuthology.orchestra.run.trial024.stdout:Creating group 'qat' with GID 992. 2026-02-13T05:48:18.548 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:18.865 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-base-2:20.2.0-636.g3b40640f.el9.x86_64 1/39 2026-02-13T05:48:18.865 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-common-2:20.2.0-636.g3b40640f.el9.x86_64 2/39 2026-02-13T05:48:18.865 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-radosgw-2:20.2.0-636.g3b40640f.el9.x86_64 3/39 2026-02-13T05:48:18.865 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-selinux-2:20.2.0-636.g3b40640f.el9.x86_64 4/39 2026-02-13T05:48:18.865 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libcephfs-daemon-2:20.2.0-636.g3b40640f.el9.x86_64 5/39 2026-02-13T05:48:18.865 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libcephfs-proxy2-2:20.2.0-636.g3b40640f.el9.x86_64 6/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libcephfs2-2:20.2.0-636.g3b40640f.el9.x86_64 7/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libradosstriper1-2:20.2.0-636.g3b40640f.el9.x86_64 8/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : librgw2-2:20.2.0-636.g3b40640f.el9.x86_64 9/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-ceph-argparse-2:20.2.0-636.g3b40640f.el9.x 10/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-ceph-common-2:20.2.0-636.g3b40640f.el9.x86 11/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-cephfs-2:20.2.0-636.g3b40640f.el9.x86_64 12/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-rados-2:20.2.0-636.g3b40640f.el9.x86_64 13/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-rbd-2:20.2.0-636.g3b40640f.el9.x86_64 14/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-rgw-2:20.2.0-636.g3b40640f.el9.x86_64 15/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-13T05:48:18.866 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-13T05:48:18.867 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-13T05:48:18.868 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-13T05:48:18.868 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-13T05:48:18.868 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-13T05:48:18.868 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : librados2-2:20.2.0-636.g3b40640f.el9.x86_64 36/39 2026-02-13T05:48:18.868 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-13T05:48:18.868 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : librbd1-2:20.2.0-636.g3b40640f.el9.x86_64 38/39 2026-02-13T05:48:18.927 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-13T05:48:18.927 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:18.927 INFO:teuthology.orchestra.run.trial024.stdout:Upgraded: 2026-02-13T05:48:18.927 INFO:teuthology.orchestra.run.trial024.stdout: librados2-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.927 INFO:teuthology.orchestra.run.trial024.stdout: librbd1-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.927 INFO:teuthology.orchestra.run.trial024.stdout:Installed: 2026-02-13T05:48:18.927 INFO:teuthology.orchestra.run.trial024.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T05:48:18.927 INFO:teuthology.orchestra.run.trial024.stdout: ceph-base-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.927 INFO:teuthology.orchestra.run.trial024.stdout: ceph-common-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.928 INFO:teuthology.orchestra.run.trial024.stdout: ceph-radosgw-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.928 INFO:teuthology.orchestra.run.trial024.stdout: ceph-selinux-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.928 INFO:teuthology.orchestra.run.trial024.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T05:48:18.928 INFO:teuthology.orchestra.run.trial024.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T05:48:18.928 INFO:teuthology.orchestra.run.trial024.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T05:48:18.928 INFO:teuthology.orchestra.run.trial024.stdout: libcephfs-daemon-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.928 INFO:teuthology.orchestra.run.trial024.stdout: libcephfs-proxy2-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.928 INFO:teuthology.orchestra.run.trial024.stdout: libcephfs2-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.928 INFO:teuthology.orchestra.run.trial024.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T05:48:18.928 INFO:teuthology.orchestra.run.trial024.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T05:48:18.929 INFO:teuthology.orchestra.run.trial024.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T05:48:18.929 INFO:teuthology.orchestra.run.trial024.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T05:48:18.929 INFO:teuthology.orchestra.run.trial024.stdout: libradosstriper1-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.929 INFO:teuthology.orchestra.run.trial024.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T05:48:18.929 INFO:teuthology.orchestra.run.trial024.stdout: librgw2-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.929 INFO:teuthology.orchestra.run.trial024.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T05:48:18.929 INFO:teuthology.orchestra.run.trial024.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T05:48:18.929 INFO:teuthology.orchestra.run.trial024.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T05:48:18.929 INFO:teuthology.orchestra.run.trial024.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-13T05:48:18.929 INFO:teuthology.orchestra.run.trial024.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T05:48:18.929 INFO:teuthology.orchestra.run.trial024.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T05:48:18.929 INFO:teuthology.orchestra.run.trial024.stdout: python3-ceph-argparse-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.930 INFO:teuthology.orchestra.run.trial024.stdout: python3-ceph-common-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.930 INFO:teuthology.orchestra.run.trial024.stdout: python3-cephfs-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.930 INFO:teuthology.orchestra.run.trial024.stdout: python3-rados-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.930 INFO:teuthology.orchestra.run.trial024.stdout: python3-rbd-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.930 INFO:teuthology.orchestra.run.trial024.stdout: python3-rgw-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:18.930 INFO:teuthology.orchestra.run.trial024.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T05:48:18.930 INFO:teuthology.orchestra.run.trial024.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T05:48:18.930 INFO:teuthology.orchestra.run.trial024.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T05:48:18.930 INFO:teuthology.orchestra.run.trial024.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T05:48:18.930 INFO:teuthology.orchestra.run.trial024.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T05:48:18.930 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:18.930 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:18.971 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install ceph-test 2026-02-13T05:48:19.270 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:17 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:19.353 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:19.354 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:19.354 INFO:teuthology.orchestra.run.trial024.stdout: Package Arch Version Repository Size 2026-02-13T05:48:19.354 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:19.355 INFO:teuthology.orchestra.run.trial024.stdout:Installing: 2026-02-13T05:48:19.355 INFO:teuthology.orchestra.run.trial024.stdout: ceph-test x86_64 2:20.2.0-636.g3b40640f.el9 ceph 84 M 2026-02-13T05:48:19.355 INFO:teuthology.orchestra.run.trial024.stdout:Installing dependencies: 2026-02-13T05:48:19.355 INFO:teuthology.orchestra.run.trial024.stdout: libcephsqlite x86_64 2:20.2.0-636.g3b40640f.el9 ceph 164 k 2026-02-13T05:48:19.355 INFO:teuthology.orchestra.run.trial024.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T05:48:19.355 INFO:teuthology.orchestra.run.trial024.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T05:48:19.355 INFO:teuthology.orchestra.run.trial024.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T05:48:19.355 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:19.355 INFO:teuthology.orchestra.run.trial024.stdout:Transaction Summary 2026-02-13T05:48:19.355 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:19.355 INFO:teuthology.orchestra.run.trial024.stdout:Install 5 Packages 2026-02-13T05:48:19.356 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:19.356 INFO:teuthology.orchestra.run.trial024.stdout:Total download size: 85 M 2026-02-13T05:48:19.356 INFO:teuthology.orchestra.run.trial024.stdout:Installed size: 364 M 2026-02-13T05:48:19.356 INFO:teuthology.orchestra.run.trial024.stdout:Downloading Packages: 2026-02-13T05:48:19.639 INFO:teuthology.orchestra.run.trial024.stdout:(1/5): libcephsqlite-20.2.0-636.g3b40640f.el9.x 838 kB/s | 164 kB 00:00 2026-02-13T05:48:20.169 INFO:teuthology.orchestra.run.trial024.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 321 kB/s | 233 kB 00:00 2026-02-13T05:48:20.392 INFO:teuthology.orchestra.run.trial024.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 402 kB/s | 303 kB 00:00 2026-02-13T05:48:20.761 INFO:teuthology.orchestra.run.trial024.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 108 kB/s | 64 kB 00:00 2026-02-13T05:48:21.590 INFO:teuthology.orchestra.run.trial024.stdout:(5/5): ceph-test-20.2.0-636.g3b40640f.el9.x86_6 39 MB/s | 84 MB 00:02 2026-02-13T05:48:21.591 INFO:teuthology.orchestra.run.trial024.stdout:-------------------------------------------------------------------------------- 2026-02-13T05:48:21.592 INFO:teuthology.orchestra.run.trial024.stdout:Total 38 MB/s | 85 MB 00:02 2026-02-13T05:48:21.618 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction check 2026-02-13T05:48:21.628 INFO:teuthology.orchestra.run.trial024.stdout:Transaction check succeeded. 2026-02-13T05:48:21.628 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction test 2026-02-13T05:48:21.915 INFO:teuthology.orchestra.run.trial024.stdout:Transaction test succeeded. 2026-02-13T05:48:21.916 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction 2026-02-13T05:48:22.228 INFO:teuthology.orchestra.run.trial024.stdout: Preparing : 1/1 2026-02-13T05:48:22.233 INFO:teuthology.orchestra.run.trial024.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-13T05:48:22.238 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-13T05:48:22.247 INFO:teuthology.orchestra.run.trial024.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-13T05:48:22.248 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libcephsqlite-2:20.2.0-636.g3b40640f.el9.x86_64 4/5 2026-02-13T05:48:25.972 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: libcephsqlite-2:20.2.0-636.g3b40640f.el9.x86_64 4/5 2026-02-13T05:48:25.990 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-test-2:20.2.0-636.g3b40640f.el9.x86_64 5/5 2026-02-13T05:48:26.327 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-test-2:20.2.0-636.g3b40640f.el9.x86_64 5/5 2026-02-13T05:48:26.327 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-test-2:20.2.0-636.g3b40640f.el9.x86_64 1/5 2026-02-13T05:48:26.327 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libcephsqlite-2:20.2.0-636.g3b40640f.el9.x86_64 2/5 2026-02-13T05:48:26.327 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-13T05:48:26.327 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-13T05:48:26.379 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-13T05:48:26.379 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:26.379 INFO:teuthology.orchestra.run.trial024.stdout:Installed: 2026-02-13T05:48:26.379 INFO:teuthology.orchestra.run.trial024.stdout: ceph-test-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:26.379 INFO:teuthology.orchestra.run.trial024.stdout: libcephsqlite-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:26.379 INFO:teuthology.orchestra.run.trial024.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T05:48:26.380 INFO:teuthology.orchestra.run.trial024.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T05:48:26.380 INFO:teuthology.orchestra.run.trial024.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T05:48:26.380 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:26.380 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:26.417 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install ceph 2026-02-13T05:48:26.712 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:24 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:26.799 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:26.801 INFO:teuthology.orchestra.run.trial024.stdout:====================================================================================== 2026-02-13T05:48:26.802 INFO:teuthology.orchestra.run.trial024.stdout: Package Arch Version Repository Size 2026-02-13T05:48:26.802 INFO:teuthology.orchestra.run.trial024.stdout:====================================================================================== 2026-02-13T05:48:26.802 INFO:teuthology.orchestra.run.trial024.stdout:Installing: 2026-02-13T05:48:26.802 INFO:teuthology.orchestra.run.trial024.stdout: ceph x86_64 2:20.2.0-636.g3b40640f.el9 ceph 6.5 k 2026-02-13T05:48:26.802 INFO:teuthology.orchestra.run.trial024.stdout:Installing dependencies: 2026-02-13T05:48:26.802 INFO:teuthology.orchestra.run.trial024.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T05:48:26.802 INFO:teuthology.orchestra.run.trial024.stdout: ceph-grafana-dashboards noarch 2:20.2.0-636.g3b40640f.el9 ceph-noarch 43 k 2026-02-13T05:48:26.802 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mds x86_64 2:20.2.0-636.g3b40640f.el9 ceph 2.3 M 2026-02-13T05:48:26.802 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr x86_64 2:20.2.0-636.g3b40640f.el9 ceph 961 k 2026-02-13T05:48:26.802 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-modules-core noarch 2:20.2.0-636.g3b40640f.el9 ceph-noarch 290 k 2026-02-13T05:48:26.802 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mon x86_64 2:20.2.0-636.g3b40640f.el9 ceph 5.0 M 2026-02-13T05:48:26.803 INFO:teuthology.orchestra.run.trial024.stdout: ceph-osd x86_64 2:20.2.0-636.g3b40640f.el9 ceph 17 M 2026-02-13T05:48:26.803 INFO:teuthology.orchestra.run.trial024.stdout: ceph-prometheus-alerts noarch 2:20.2.0-636.g3b40640f.el9 ceph-noarch 17 k 2026-02-13T05:48:26.803 INFO:teuthology.orchestra.run.trial024.stdout: cephadm noarch 2:20.2.0-636.g3b40640f.el9 ceph-noarch 1.0 M 2026-02-13T05:48:26.803 INFO:teuthology.orchestra.run.trial024.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T05:48:26.803 INFO:teuthology.orchestra.run.trial024.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T05:48:26.803 INFO:teuthology.orchestra.run.trial024.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T05:48:26.803 INFO:teuthology.orchestra.run.trial024.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T05:48:26.803 INFO:teuthology.orchestra.run.trial024.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T05:48:26.803 INFO:teuthology.orchestra.run.trial024.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T05:48:26.803 INFO:teuthology.orchestra.run.trial024.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T05:48:26.803 INFO:teuthology.orchestra.run.trial024.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T05:48:26.803 INFO:teuthology.orchestra.run.trial024.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T05:48:26.804 INFO:teuthology.orchestra.run.trial024.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T05:48:26.805 INFO:teuthology.orchestra.run.trial024.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-13T05:48:26.806 INFO:teuthology.orchestra.run.trial024.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T05:48:26.807 INFO:teuthology.orchestra.run.trial024.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T05:48:26.807 INFO:teuthology.orchestra.run.trial024.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T05:48:26.807 INFO:teuthology.orchestra.run.trial024.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T05:48:26.807 INFO:teuthology.orchestra.run.trial024.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T05:48:26.807 INFO:teuthology.orchestra.run.trial024.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T05:48:26.807 INFO:teuthology.orchestra.run.trial024.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T05:48:26.807 INFO:teuthology.orchestra.run.trial024.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T05:48:26.807 INFO:teuthology.orchestra.run.trial024.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T05:48:26.807 INFO:teuthology.orchestra.run.trial024.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T05:48:26.807 INFO:teuthology.orchestra.run.trial024.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T05:48:26.807 INFO:teuthology.orchestra.run.trial024.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T05:48:26.807 INFO:teuthology.orchestra.run.trial024.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T05:48:26.808 INFO:teuthology.orchestra.run.trial024.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T05:48:26.809 INFO:teuthology.orchestra.run.trial024.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-13T05:48:26.809 INFO:teuthology.orchestra.run.trial024.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-13T05:48:26.809 INFO:teuthology.orchestra.run.trial024.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T05:48:26.809 INFO:teuthology.orchestra.run.trial024.stdout:Installing weak dependencies: 2026-02-13T05:48:26.809 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-cephadm noarch 2:20.2.0-636.g3b40640f.el9 ceph-noarch 173 k 2026-02-13T05:48:26.809 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-dashboard noarch 2:20.2.0-636.g3b40640f.el9 ceph-noarch 11 M 2026-02-13T05:48:26.809 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-636.g3b40640f.el9 ceph-noarch 7.4 M 2026-02-13T05:48:26.809 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-636.g3b40640f.el9 ceph-noarch 22 k 2026-02-13T05:48:26.809 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-rook noarch 2:20.2.0-636.g3b40640f.el9 ceph-noarch 50 k 2026-02-13T05:48:26.809 INFO:teuthology.orchestra.run.trial024.stdout: ceph-volume noarch 2:20.2.0-636.g3b40640f.el9 ceph-noarch 297 k 2026-02-13T05:48:26.809 INFO:teuthology.orchestra.run.trial024.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-13T05:48:26.809 INFO:teuthology.orchestra.run.trial024.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-13T05:48:26.810 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:26.810 INFO:teuthology.orchestra.run.trial024.stdout:Transaction Summary 2026-02-13T05:48:26.810 INFO:teuthology.orchestra.run.trial024.stdout:====================================================================================== 2026-02-13T05:48:26.810 INFO:teuthology.orchestra.run.trial024.stdout:Install 95 Packages 2026-02-13T05:48:26.810 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:26.811 INFO:teuthology.orchestra.run.trial024.stdout:Total download size: 101 M 2026-02-13T05:48:26.811 INFO:teuthology.orchestra.run.trial024.stdout:Installed size: 561 M 2026-02-13T05:48:26.811 INFO:teuthology.orchestra.run.trial024.stdout:Downloading Packages: 2026-02-13T05:48:27.415 INFO:teuthology.orchestra.run.trial024.stdout:(1/95): ceph-20.2.0-636.g3b40640f.el9.x86_64.rp 118 kB/s | 6.5 kB 00:00 2026-02-13T05:48:27.488 INFO:teuthology.orchestra.run.trial024.stdout:(2/95): ceph-mgr-20.2.0-636.g3b40640f.el9.x86_6 7.4 MB/s | 961 kB 00:00 2026-02-13T05:48:27.511 INFO:teuthology.orchestra.run.trial024.stdout:(3/95): ceph-mds-20.2.0-636.g3b40640f.el9.x86_6 16 MB/s | 2.3 MB 00:00 2026-02-13T05:48:27.537 INFO:teuthology.orchestra.run.trial024.stdout:(4/95): ceph-grafana-dashboards-20.2.0-636.g3b4 1.6 MB/s | 43 kB 00:00 2026-02-13T05:48:27.568 INFO:teuthology.orchestra.run.trial024.stdout:(5/95): ceph-mgr-cephadm-20.2.0-636.g3b40640f.e 5.5 MB/s | 173 kB 00:00 2026-02-13T05:48:27.759 INFO:teuthology.orchestra.run.trial024.stdout:(6/95): ceph-mon-20.2.0-636.g3b40640f.el9.x86_6 15 MB/s | 5.0 MB 00:00 2026-02-13T05:48:27.986 INFO:teuthology.orchestra.run.trial024.stdout:(7/95): ceph-mgr-dashboard-20.2.0-636.g3b40640f 25 MB/s | 11 MB 00:00 2026-02-13T05:48:28.022 INFO:teuthology.orchestra.run.trial024.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-636.g3b40640f 622 kB/s | 22 kB 00:00 2026-02-13T05:48:28.069 INFO:teuthology.orchestra.run.trial024.stdout:(9/95): ceph-mgr-modules-core-20.2.0-636.g3b406 6.0 MB/s | 290 kB 00:00 2026-02-13T05:48:28.114 INFO:teuthology.orchestra.run.trial024.stdout:(10/95): ceph-mgr-rook-20.2.0-636.g3b40640f.el9 1.1 MB/s | 50 kB 00:00 2026-02-13T05:48:28.161 INFO:teuthology.orchestra.run.trial024.stdout:(11/95): ceph-prometheus-alerts-20.2.0-636.g3b4 371 kB/s | 17 kB 00:00 2026-02-13T05:48:28.191 INFO:teuthology.orchestra.run.trial024.stdout:(12/95): ceph-mgr-diskprediction-local-20.2.0-6 17 MB/s | 7.4 MB 00:00 2026-02-13T05:48:28.214 INFO:teuthology.orchestra.run.trial024.stdout:(13/95): ceph-osd-20.2.0-636.g3b40640f.el9.x86_ 23 MB/s | 17 MB 00:00 2026-02-13T05:48:28.216 INFO:teuthology.orchestra.run.trial024.stdout:(14/95): ceph-volume-20.2.0-636.g3b40640f.el9.n 5.3 MB/s | 297 kB 00:00 2026-02-13T05:48:28.218 INFO:teuthology.orchestra.run.trial024.stdout:(15/95): cephadm-20.2.0-636.g3b40640f.el9.noarc 37 MB/s | 1.0 MB 00:00 2026-02-13T05:48:28.242 INFO:teuthology.orchestra.run.trial024.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.5 MB/s | 40 kB 00:00 2026-02-13T05:48:28.259 INFO:teuthology.orchestra.run.trial024.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 1.7 MB/s | 72 kB 00:00 2026-02-13T05:48:28.279 INFO:teuthology.orchestra.run.trial024.stdout:(18/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 5.3 MB/s | 350 kB 00:00 2026-02-13T05:48:28.283 INFO:teuthology.orchestra.run.trial024.stdout:(19/95): libquadmath-11.5.0-14.el9.x86_64.rpm 7.6 MB/s | 184 kB 00:00 2026-02-13T05:48:28.287 INFO:teuthology.orchestra.run.trial024.stdout:(20/95): libgfortran-11.5.0-14.el9.x86_64.rpm 17 MB/s | 794 kB 00:00 2026-02-13T05:48:28.294 INFO:teuthology.orchestra.run.trial024.stdout:(21/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 17 MB/s | 253 kB 00:00 2026-02-13T05:48:28.298 INFO:teuthology.orchestra.run.trial024.stdout:(22/95): python3-ply-3.11-14.el9.noarch.rpm 9.7 MB/s | 106 kB 00:00 2026-02-13T05:48:28.307 INFO:teuthology.orchestra.run.trial024.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 10 MB/s | 135 kB 00:00 2026-02-13T05:48:28.308 INFO:teuthology.orchestra.run.trial024.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 15 MB/s | 150 kB 00:00 2026-02-13T05:48:28.319 INFO:teuthology.orchestra.run.trial024.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 11 MB/s | 126 kB 00:00 2026-02-13T05:48:28.320 INFO:teuthology.orchestra.run.trial024.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 17 MB/s | 218 kB 00:00 2026-02-13T05:48:28.326 INFO:teuthology.orchestra.run.trial024.stdout:(27/95): python3-cryptography-36.0.1-5.el9.x86_ 29 MB/s | 1.2 MB 00:00 2026-02-13T05:48:28.332 INFO:teuthology.orchestra.run.trial024.stdout:(28/95): unzip-6.0-59.el9.x86_64.rpm 14 MB/s | 182 kB 00:00 2026-02-13T05:48:28.332 INFO:teuthology.orchestra.run.trial024.stdout:(29/95): zip-3.0-35.el9.x86_64.rpm 22 MB/s | 266 kB 00:00 2026-02-13T05:48:28.338 INFO:teuthology.orchestra.run.trial024.stdout:(30/95): flexiblas-3.0.4-8.el9.x86_64.rpm 2.7 MB/s | 33 kB 00:00 2026-02-13T05:48:28.342 INFO:teuthology.orchestra.run.trial024.stdout:(31/95): flexiblas-openblas-openmp-3.0.4-8.el9. 1.8 MB/s | 18 kB 00:00 2026-02-13T05:48:28.354 INFO:teuthology.orchestra.run.trial024.stdout:(32/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 15 MB/s | 246 kB 00:00 2026-02-13T05:48:28.355 INFO:teuthology.orchestra.run.trial024.stdout:(33/95): lua-5.4.4-4.el9.x86_64.rpm 15 MB/s | 188 kB 00:00 2026-02-13T05:48:28.359 INFO:teuthology.orchestra.run.trial024.stdout:(34/95): openblas-0.3.29-1.el9.x86_64.rpm 9.1 MB/s | 42 kB 00:00 2026-02-13T05:48:28.376 INFO:teuthology.orchestra.run.trial024.stdout:(35/95): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 69 MB/s | 3.0 MB 00:00 2026-02-13T05:48:28.393 INFO:teuthology.orchestra.run.trial024.stdout:(36/95): protobuf-3.14.0-17.el9.x86_64.rpm 29 MB/s | 1.0 MB 00:00 2026-02-13T05:48:28.403 INFO:teuthology.orchestra.run.trial024.stdout:(37/95): python3-devel-3.9.25-2.el9.x86_64.rpm 25 MB/s | 244 kB 00:00 2026-02-13T05:48:28.417 INFO:teuthology.orchestra.run.trial024.stdout:(38/95): python3-babel-2.9.1-2.el9.noarch.rpm 144 MB/s | 6.0 MB 00:00 2026-02-13T05:48:28.418 INFO:teuthology.orchestra.run.trial024.stdout:(39/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 16 MB/s | 249 kB 00:00 2026-02-13T05:48:28.422 INFO:teuthology.orchestra.run.trial024.stdout:(40/95): python3-jmespath-1.0.1-1.el9.noarch.rp 8.7 MB/s | 48 kB 00:00 2026-02-13T05:48:28.426 INFO:teuthology.orchestra.run.trial024.stdout:(41/95): python3-libstoragemgmt-1.10.1-1.el9.x8 22 MB/s | 177 kB 00:00 2026-02-13T05:48:28.431 INFO:teuthology.orchestra.run.trial024.stdout:(42/95): python3-markupsafe-1.1.1-12.el9.x86_64 7.0 MB/s | 35 kB 00:00 2026-02-13T05:48:28.434 INFO:teuthology.orchestra.run.trial024.stdout:(43/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 103 MB/s | 1.2 MB 00:00 2026-02-13T05:48:28.442 INFO:teuthology.orchestra.run.trial024.stdout:(44/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 56 MB/s | 442 kB 00:00 2026-02-13T05:48:28.448 INFO:teuthology.orchestra.run.trial024.stdout:(45/95): python3-packaging-20.9-5.el9.noarch.rp 13 MB/s | 77 kB 00:00 2026-02-13T05:48:28.455 INFO:teuthology.orchestra.run.trial024.stdout:(46/95): python3-protobuf-3.14.0-17.el9.noarch. 39 MB/s | 267 kB 00:00 2026-02-13T05:48:28.462 INFO:teuthology.orchestra.run.trial024.stdout:(47/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 23 MB/s | 159 kB 00:00 2026-02-13T05:48:28.469 INFO:teuthology.orchestra.run.trial024.stdout:(48/95): python3-pyasn1-modules-0.4.8-6.el9.noa 38 MB/s | 279 kB 00:00 2026-02-13T05:48:28.474 INFO:teuthology.orchestra.run.trial024.stdout:(49/95): python3-requests-oauthlib-1.3.0-12.el9 10 MB/s | 54 kB 00:00 2026-02-13T05:48:28.503 INFO:teuthology.orchestra.run.trial024.stdout:(50/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 85 MB/s | 6.1 MB 00:00 2026-02-13T05:48:28.509 INFO:teuthology.orchestra.run.trial024.stdout:(51/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 34 MB/s | 5.3 MB 00:00 2026-02-13T05:48:28.510 INFO:teuthology.orchestra.run.trial024.stdout:(52/95): python3-toml-0.10.2-6.el9.noarch.rpm 6.2 MB/s | 42 kB 00:00 2026-02-13T05:48:28.515 INFO:teuthology.orchestra.run.trial024.stdout:(53/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 17 MB/s | 90 kB 00:00 2026-02-13T05:48:28.516 INFO:teuthology.orchestra.run.trial024.stdout:(54/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 28 MB/s | 189 kB 00:00 2026-02-13T05:48:28.563 INFO:teuthology.orchestra.run.trial024.stdout:(55/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 217 MB/s | 19 MB 00:00 2026-02-13T05:48:28.850 INFO:teuthology.orchestra.run.trial024.stdout:(56/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.9 MB/s | 551 kB 00:00 2026-02-13T05:48:28.884 INFO:teuthology.orchestra.run.trial024.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 582 kB/s | 19 kB 00:00 2026-02-13T05:48:28.926 INFO:teuthology.orchestra.run.trial024.stdout:(58/95): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2026-02-13T05:48:28.971 INFO:teuthology.orchestra.run.trial024.stdout:(59/95): lua-devel-5.4.4-4.el9.x86_64.rpm 49 kB/s | 22 kB 00:00 2026-02-13T05:48:28.991 INFO:teuthology.orchestra.run.trial024.stdout:(60/95): python3-asyncssh-2.13.2-5.el9.noarch.r 8.3 MB/s | 548 kB 00:00 2026-02-13T05:48:29.004 INFO:teuthology.orchestra.run.trial024.stdout:(61/95): python3-autocommand-2.2.2-8.el9.noarch 885 kB/s | 29 kB 00:00 2026-02-13T05:48:29.027 INFO:teuthology.orchestra.run.trial024.stdout:(62/95): python3-backports-tarfile-1.2.0-1.el9. 1.6 MB/s | 60 kB 00:00 2026-02-13T05:48:29.040 INFO:teuthology.orchestra.run.trial024.stdout:(63/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.2 MB/s | 43 kB 00:00 2026-02-13T05:48:29.061 INFO:teuthology.orchestra.run.trial024.stdout:(64/95): python3-cachetools-4.2.4-1.el9.noarch. 939 kB/s | 32 kB 00:00 2026-02-13T05:48:29.074 INFO:teuthology.orchestra.run.trial024.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 419 kB/s | 14 kB 00:00 2026-02-13T05:48:29.103 INFO:teuthology.orchestra.run.trial024.stdout:(66/95): python3-cheroot-10.0.1-4.el9.noarch.rp 4.1 MB/s | 173 kB 00:00 2026-02-13T05:48:29.129 INFO:teuthology.orchestra.run.trial024.stdout:(67/95): python3-cherrypy-18.6.1-2.el9.noarch.r 6.4 MB/s | 358 kB 00:00 2026-02-13T05:48:29.150 INFO:teuthology.orchestra.run.trial024.stdout:(68/95): python3-google-auth-2.45.0-1.el9.noarc 5.3 MB/s | 254 kB 00:00 2026-02-13T05:48:29.296 INFO:teuthology.orchestra.run.trial024.stdout:(69/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2026-02-13T05:48:29.298 INFO:teuthology.orchestra.run.trial024.stdout:(70/95): python3-grpcio-tools-1.46.7-10.el9.x86 980 kB/s | 144 kB 00:00 2026-02-13T05:48:29.335 INFO:teuthology.orchestra.run.trial024.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 3.5 MB/s | 139 kB 00:00 2026-02-13T05:48:29.338 INFO:teuthology.orchestra.run.trial024.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 1.4 MB/s | 56 kB 00:00 2026-02-13T05:48:29.367 INFO:teuthology.orchestra.run.trial024.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 340 kB/s | 11 kB 00:00 2026-02-13T05:48:29.370 INFO:teuthology.orchestra.run.trial024.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 546 kB/s | 18 kB 00:00 2026-02-13T05:48:29.401 INFO:teuthology.orchestra.run.trial024.stdout:(75/95): python3-jaraco-collections-3.0.0-8.el9 680 kB/s | 23 kB 00:00 2026-02-13T05:48:29.403 INFO:teuthology.orchestra.run.trial024.stdout:(76/95): python3-jaraco-context-6.0.1-3.el9.noa 613 kB/s | 20 kB 00:00 2026-02-13T05:48:29.434 INFO:teuthology.orchestra.run.trial024.stdout:(77/95): python3-jaraco-functools-3.5.0-2.el9.n 603 kB/s | 19 kB 00:00 2026-02-13T05:48:29.437 INFO:teuthology.orchestra.run.trial024.stdout:(78/95): python3-jaraco-text-4.0.0-2.el9.noarch 764 kB/s | 26 kB 00:00 2026-02-13T05:48:29.528 INFO:teuthology.orchestra.run.trial024.stdout:(79/95): python3-kubernetes-26.1.0-3.el9.noarch 11 MB/s | 1.0 MB 00:00 2026-02-13T05:48:29.532 INFO:teuthology.orchestra.run.trial024.stdout:(80/95): python3-more-itertools-8.12.0-2.el9.no 828 kB/s | 79 kB 00:00 2026-02-13T05:48:29.567 INFO:teuthology.orchestra.run.trial024.stdout:(81/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.2 MB/s | 86 kB 00:00 2026-02-13T05:48:29.571 INFO:teuthology.orchestra.run.trial024.stdout:(82/95): python3-natsort-7.1.1-5.el9.noarch.rpm 1.5 MB/s | 58 kB 00:00 2026-02-13T05:48:29.602 INFO:teuthology.orchestra.run.trial024.stdout:(83/95): python3-portend-3.1.0-2.el9.noarch.rpm 473 kB/s | 16 kB 00:00 2026-02-13T05:48:29.609 INFO:teuthology.orchestra.run.trial024.stdout:(84/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.3 MB/s | 90 kB 00:00 2026-02-13T05:48:29.637 INFO:teuthology.orchestra.run.trial024.stdout:(85/95): python3-repoze-lru-0.7-16.el9.noarch.r 891 kB/s | 31 kB 00:00 2026-02-13T05:48:29.653 INFO:teuthology.orchestra.run.trial024.stdout:(86/95): python3-routes-2.5.1-5.el9.noarch.rpm 4.2 MB/s | 188 kB 00:00 2026-02-13T05:48:29.673 INFO:teuthology.orchestra.run.trial024.stdout:(87/95): python3-rsa-4.9-2.el9.noarch.rpm 1.6 MB/s | 59 kB 00:00 2026-02-13T05:48:29.692 INFO:teuthology.orchestra.run.trial024.stdout:(88/95): python3-saml-1.16.0-1.el9.noarch.rpm 3.1 MB/s | 125 kB 00:00 2026-02-13T05:48:29.708 INFO:teuthology.orchestra.run.trial024.stdout:(89/95): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2026-02-13T05:48:29.721 INFO:teuthology.orchestra.run.trial024.stdout:(90/95): protobuf-compiler-3.14.0-17.el9.x86_64 715 kB/s | 862 kB 00:01 2026-02-13T05:48:29.726 INFO:teuthology.orchestra.run.trial024.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 2.5 MB/s | 86 kB 00:00 2026-02-13T05:48:29.745 INFO:teuthology.orchestra.run.trial024.stdout:(92/95): python3-websocket-client-1.2.3-2.el9.n 2.3 MB/s | 90 kB 00:00 2026-02-13T05:48:29.758 INFO:teuthology.orchestra.run.trial024.stdout:(93/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.3 MB/s | 48 kB 00:00 2026-02-13T05:48:29.763 INFO:teuthology.orchestra.run.trial024.stdout:(94/95): python3-xmltodict-0.12.0-15.el9.noarch 596 kB/s | 22 kB 00:00 2026-02-13T05:48:29.779 INFO:teuthology.orchestra.run.trial024.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 604 kB/s | 20 kB 00:00 2026-02-13T05:48:29.780 INFO:teuthology.orchestra.run.trial024.stdout:-------------------------------------------------------------------------------- 2026-02-13T05:48:29.780 INFO:teuthology.orchestra.run.trial024.stdout:Total 34 MB/s | 101 MB 00:02 2026-02-13T05:48:30.228 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction check 2026-02-13T05:48:30.265 INFO:teuthology.orchestra.run.trial024.stdout:Transaction check succeeded. 2026-02-13T05:48:30.265 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction test 2026-02-13T05:48:30.699 INFO:teuthology.orchestra.run.trial024.stdout:Transaction test succeeded. 2026-02-13T05:48:30.699 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction 2026-02-13T05:48:31.171 INFO:teuthology.orchestra.run.trial024.stdout: Preparing : 1/1 2026-02-13T05:48:31.173 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-13T05:48:31.177 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-13T05:48:31.199 INFO:teuthology.orchestra.run.trial024.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-13T05:48:31.232 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-13T05:48:31.241 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-13T05:48:31.247 INFO:teuthology.orchestra.run.trial024.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-13T05:48:31.250 INFO:teuthology.orchestra.run.trial024.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-13T05:48:31.254 INFO:teuthology.orchestra.run.trial024.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 8/95 2026-02-13T05:48:31.277 INFO:teuthology.orchestra.run.trial024.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-13T05:48:31.290 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-13T05:48:31.293 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-13T05:48:31.299 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-13T05:48:31.301 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-13T05:48:31.312 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-13T05:48:31.318 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-13T05:48:31.342 INFO:teuthology.orchestra.run.trial024.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-13T05:48:31.345 INFO:teuthology.orchestra.run.trial024.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-13T05:48:31.352 INFO:teuthology.orchestra.run.trial024.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-13T05:48:31.403 INFO:teuthology.orchestra.run.trial024.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-13T05:48:31.416 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-13T05:48:31.418 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-13T05:48:31.423 INFO:teuthology.orchestra.run.trial024.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-13T05:48:31.428 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-13T05:48:31.432 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-13T05:48:31.436 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-13T05:48:31.450 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-13T05:48:31.455 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-13T05:48:31.460 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-13T05:48:31.471 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-13T05:48:31.480 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-13T05:48:31.486 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-13T05:48:31.506 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-13T05:48:31.517 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-13T05:48:31.532 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-13T05:48:31.537 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-13T05:48:31.545 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-13T05:48:31.585 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-13T05:48:31.909 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-13T05:48:31.919 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-13T05:48:31.923 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-13T05:48:31.929 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-13T05:48:31.931 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-13T05:48:31.959 INFO:teuthology.orchestra.run.trial024.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-13T05:48:32.003 INFO:teuthology.orchestra.run.trial024.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-13T05:48:32.010 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-13T05:48:32.013 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-13T05:48:32.019 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-13T05:48:32.023 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-13T05:48:32.030 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-13T05:48:32.033 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-13T05:48:32.061 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-13T05:48:32.071 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-13T05:48:32.077 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-13T05:48:32.084 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-13T05:48:32.119 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-13T05:48:32.343 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-13T05:48:32.367 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-13T05:48:32.371 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-13T05:48:32.429 INFO:teuthology.orchestra.run.trial024.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-13T05:48:32.431 INFO:teuthology.orchestra.run.trial024.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-13T05:48:32.452 INFO:teuthology.orchestra.run.trial024.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 61/95 2026-02-13T05:48:32.780 INFO:teuthology.orchestra.run.trial024.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 62/95 2026-02-13T05:48:32.853 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-13T05:48:33.522 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-13T05:48:33.540 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-13T05:48:33.550 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-13T05:48:33.556 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-13T05:48:33.570 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-13T05:48:33.585 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-13T05:48:33.660 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-13T05:48:33.669 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-13T05:48:33.693 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-13T05:48:33.722 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-13T05:48:33.773 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-13T05:48:33.779 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-13T05:48:33.782 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-13T05:48:33.784 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-13T05:48:33.801 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-13T05:48:33.801 INFO:teuthology.orchestra.run.trial024.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T05:48:33.801 INFO:teuthology.orchestra.run.trial024.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T05:48:33.802 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:33.809 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-13T05:48:33.834 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-13T05:48:33.834 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T05:48:33.835 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:33.871 INFO:teuthology.orchestra.run.trial024.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-13T05:48:33.934 INFO:teuthology.orchestra.run.trial024.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-13T05:48:33.936 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-volume-2:20.2.0-636.g3b40640f.el9.noarch 81/95 2026-02-13T05:48:33.950 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-volume-2:20.2.0-636.g3b40640f.el9.noarch 81/95 2026-02-13T05:48:33.951 INFO:teuthology.orchestra.run.trial024.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T05:48:33.951 INFO:teuthology.orchestra.run.trial024.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T05:48:33.951 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:34.639 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-osd-2:20.2.0-636.g3b40640f.el9.x86_64 82/95 2026-02-13T05:48:34.664 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-osd-2:20.2.0-636.g3b40640f.el9.x86_64 82/95 2026-02-13T05:48:34.665 INFO:teuthology.orchestra.run.trial024.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T05:48:34.665 INFO:teuthology.orchestra.run.trial024.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T05:48:34.665 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T05:48:34.665 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T05:48:34.665 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:34.725 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: cephadm-2:20.2.0-636.g3b40640f.el9.noarch 83/95 2026-02-13T05:48:34.728 INFO:teuthology.orchestra.run.trial024.stdout: Installing : cephadm-2:20.2.0-636.g3b40640f.el9.noarch 83/95 2026-02-13T05:48:34.734 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-636.g3b40640f.el9. 84/95 2026-02-13T05:48:34.758 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-636.g3b40640f.el9 85/95 2026-02-13T05:48:34.759 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-636.g3b40640f.el9.noarch 86/95 2026-02-13T05:48:35.909 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-636.g3b40640f.el9.noarch 86/95 2026-02-13T05:48:35.914 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-636.g3b40640f.el9.noar 87/95 2026-02-13T05:48:36.372 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-636.g3b40640f.el9.noar 87/95 2026-02-13T05:48:36.373 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-636.g3b4064 88/95 2026-02-13T05:48:36.385 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-636.g3b4064 88/95 2026-02-13T05:48:36.386 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-636.g3b40640f.el9.noar 89/95 2026-02-13T05:48:36.444 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-636.g3b40640f.el9.noar 89/95 2026-02-13T05:48:36.488 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-636.g3b40640f.el9.n 90/95 2026-02-13T05:48:36.489 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-mgr-2:20.2.0-636.g3b40640f.el9.x86_64 91/95 2026-02-13T05:48:36.511 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-mgr-2:20.2.0-636.g3b40640f.el9.x86_64 91/95 2026-02-13T05:48:36.511 INFO:teuthology.orchestra.run.trial024.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T05:48:36.511 INFO:teuthology.orchestra.run.trial024.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T05:48:36.512 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T05:48:36.512 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T05:48:36.512 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:36.523 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-mgr-rook-2:20.2.0-636.g3b40640f.el9.noarch 92/95 2026-02-13T05:48:36.753 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-636.g3b40640f.el9.noarch 92/95 2026-02-13T05:48:36.754 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-mon-2:20.2.0-636.g3b40640f.el9.x86_64 93/95 2026-02-13T05:48:36.777 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-mon-2:20.2.0-636.g3b40640f.el9.x86_64 93/95 2026-02-13T05:48:36.777 INFO:teuthology.orchestra.run.trial024.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T05:48:36.777 INFO:teuthology.orchestra.run.trial024.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T05:48:36.777 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T05:48:36.777 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T05:48:36.778 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:36.879 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-mds-2:20.2.0-636.g3b40640f.el9.x86_64 94/95 2026-02-13T05:48:36.901 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-mds-2:20.2.0-636.g3b40640f.el9.x86_64 94/95 2026-02-13T05:48:36.901 INFO:teuthology.orchestra.run.trial024.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T05:48:36.901 INFO:teuthology.orchestra.run.trial024.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T05:48:36.901 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T05:48:36.901 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T05:48:36.901 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:36.920 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-2:20.2.0-636.g3b40640f.el9.x86_64 95/95 2026-02-13T05:48:37.616 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-2:20.2.0-636.g3b40640f.el9.x86_64 95/95 2026-02-13T05:48:37.616 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-2:20.2.0-636.g3b40640f.el9.x86_64 1/95 2026-02-13T05:48:37.616 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-mds-2:20.2.0-636.g3b40640f.el9.x86_64 2/95 2026-02-13T05:48:37.616 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-mgr-2:20.2.0-636.g3b40640f.el9.x86_64 3/95 2026-02-13T05:48:37.616 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-mon-2:20.2.0-636.g3b40640f.el9.x86_64 4/95 2026-02-13T05:48:37.616 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-osd-2:20.2.0-636.g3b40640f.el9.x86_64 5/95 2026-02-13T05:48:37.616 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-636.g3b40640f.el9 6/95 2026-02-13T05:48:37.617 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-636.g3b40640f.el9.noarch 7/95 2026-02-13T05:48:37.617 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-636.g3b40640f.el9.noar 8/95 2026-02-13T05:48:37.617 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-636.g3b4064 9/95 2026-02-13T05:48:37.617 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-636.g3b40640f.el9.noar 10/95 2026-02-13T05:48:37.617 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-636.g3b40640f.el9.n 11/95 2026-02-13T05:48:37.617 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-mgr-rook-2:20.2.0-636.g3b40640f.el9.noarch 12/95 2026-02-13T05:48:37.617 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-636.g3b40640f.el9. 13/95 2026-02-13T05:48:37.617 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-volume-2:20.2.0-636.g3b40640f.el9.noarch 14/95 2026-02-13T05:48:37.617 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : cephadm-2:20.2.0-636.g3b40640f.el9.noarch 15/95 2026-02-13T05:48:37.617 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-13T05:48:37.617 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-13T05:48:37.617 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-13T05:48:37.618 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-13T05:48:37.618 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-13T05:48:37.618 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-13T05:48:37.618 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-13T05:48:37.618 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-13T05:48:37.618 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-13T05:48:37.618 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-13T05:48:37.618 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-13T05:48:37.619 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-13T05:48:37.619 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-13T05:48:37.619 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-13T05:48:37.619 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 30/95 2026-02-13T05:48:37.619 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 31/95 2026-02-13T05:48:37.619 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 32/95 2026-02-13T05:48:37.619 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-13T05:48:37.619 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-13T05:48:37.619 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-13T05:48:37.619 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-13T05:48:37.619 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-13T05:48:37.619 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-13T05:48:37.620 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-13T05:48:37.620 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-13T05:48:37.620 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-13T05:48:37.620 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-13T05:48:37.620 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-13T05:48:37.620 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-13T05:48:37.620 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-13T05:48:37.620 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-13T05:48:37.620 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-13T05:48:37.620 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-13T05:48:37.620 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-13T05:48:37.620 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-13T05:48:37.621 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-13T05:48:37.622 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-13T05:48:37.623 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-13T05:48:37.624 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-13T05:48:37.624 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-13T05:48:37.624 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-13T05:48:37.624 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-13T05:48:37.624 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-13T05:48:37.680 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-13T05:48:37.680 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:37.680 INFO:teuthology.orchestra.run.trial024.stdout:Installed: 2026-02-13T05:48:37.680 INFO:teuthology.orchestra.run.trial024.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T05:48:37.680 INFO:teuthology.orchestra.run.trial024.stdout: ceph-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:37.680 INFO:teuthology.orchestra.run.trial024.stdout: ceph-grafana-dashboards-2:20.2.0-636.g3b40640f.el9.noarch 2026-02-13T05:48:37.680 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mds-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:37.680 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:37.680 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-cephadm-2:20.2.0-636.g3b40640f.el9.noarch 2026-02-13T05:48:37.680 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-dashboard-2:20.2.0-636.g3b40640f.el9.noarch 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-diskprediction-local-2:20.2.0-636.g3b40640f.el9.noarch 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-k8sevents-2:20.2.0-636.g3b40640f.el9.noarch 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-modules-core-2:20.2.0-636.g3b40640f.el9.noarch 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mgr-rook-2:20.2.0-636.g3b40640f.el9.noarch 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: ceph-mon-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: ceph-osd-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: ceph-prometheus-alerts-2:20.2.0-636.g3b40640f.el9.noarch 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: ceph-volume-2:20.2.0-636.g3b40640f.el9.noarch 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: cephadm-2:20.2.0-636.g3b40640f.el9.noarch 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T05:48:37.681 INFO:teuthology.orchestra.run.trial024.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T05:48:37.682 INFO:teuthology.orchestra.run.trial024.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T05:48:37.682 INFO:teuthology.orchestra.run.trial024.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T05:48:37.682 INFO:teuthology.orchestra.run.trial024.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T05:48:37.682 INFO:teuthology.orchestra.run.trial024.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T05:48:37.682 INFO:teuthology.orchestra.run.trial024.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T05:48:37.682 INFO:teuthology.orchestra.run.trial024.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T05:48:37.682 INFO:teuthology.orchestra.run.trial024.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T05:48:37.682 INFO:teuthology.orchestra.run.trial024.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T05:48:37.682 INFO:teuthology.orchestra.run.trial024.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T05:48:37.682 INFO:teuthology.orchestra.run.trial024.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T05:48:37.682 INFO:teuthology.orchestra.run.trial024.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T05:48:37.682 INFO:teuthology.orchestra.run.trial024.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T05:48:37.683 INFO:teuthology.orchestra.run.trial024.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T05:48:37.684 INFO:teuthology.orchestra.run.trial024.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T05:48:37.685 INFO:teuthology.orchestra.run.trial024.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T05:48:37.686 INFO:teuthology.orchestra.run.trial024.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T05:48:37.687 INFO:teuthology.orchestra.run.trial024.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T05:48:37.687 INFO:teuthology.orchestra.run.trial024.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T05:48:37.687 INFO:teuthology.orchestra.run.trial024.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T05:48:37.687 INFO:teuthology.orchestra.run.trial024.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T05:48:37.687 INFO:teuthology.orchestra.run.trial024.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-13T05:48:37.687 INFO:teuthology.orchestra.run.trial024.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T05:48:37.687 INFO:teuthology.orchestra.run.trial024.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T05:48:37.687 INFO:teuthology.orchestra.run.trial024.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T05:48:37.687 INFO:teuthology.orchestra.run.trial024.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-13T05:48:37.687 INFO:teuthology.orchestra.run.trial024.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-13T05:48:37.687 INFO:teuthology.orchestra.run.trial024.stdout: zip-3.0-35.el9.x86_64 2026-02-13T05:48:37.687 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:37.688 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:37.735 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install ceph-base 2026-02-13T05:48:38.033 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:36 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:38.098 INFO:teuthology.orchestra.run.trial024.stdout:Package ceph-base-2:20.2.0-636.g3b40640f.el9.x86_64 is already installed. 2026-02-13T05:48:38.116 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:38.117 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:38.117 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:38.137 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install cephadm 2026-02-13T05:48:38.437 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:36 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:38.502 INFO:teuthology.orchestra.run.trial024.stdout:Package cephadm-2:20.2.0-636.g3b40640f.el9.noarch is already installed. 2026-02-13T05:48:38.520 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:38.520 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:38.521 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:38.541 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install ceph-immutable-object-cache 2026-02-13T05:48:38.840 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:36 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:38.923 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:38.923 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:38.924 INFO:teuthology.orchestra.run.trial024.stdout: Package Arch Version Repo Size 2026-02-13T05:48:38.924 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:38.924 INFO:teuthology.orchestra.run.trial024.stdout:Installing: 2026-02-13T05:48:38.924 INFO:teuthology.orchestra.run.trial024.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-636.g3b40640f.el9 ceph 154 k 2026-02-13T05:48:38.924 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:38.924 INFO:teuthology.orchestra.run.trial024.stdout:Transaction Summary 2026-02-13T05:48:38.924 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:38.924 INFO:teuthology.orchestra.run.trial024.stdout:Install 1 Package 2026-02-13T05:48:38.924 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:38.924 INFO:teuthology.orchestra.run.trial024.stdout:Total download size: 154 k 2026-02-13T05:48:38.924 INFO:teuthology.orchestra.run.trial024.stdout:Installed size: 447 k 2026-02-13T05:48:38.925 INFO:teuthology.orchestra.run.trial024.stdout:Downloading Packages: 2026-02-13T05:48:39.008 INFO:teuthology.orchestra.run.trial024.stdout:ceph-immutable-object-cache-20.2.0-636.g3b40640 1.8 MB/s | 154 kB 00:00 2026-02-13T05:48:39.009 INFO:teuthology.orchestra.run.trial024.stdout:-------------------------------------------------------------------------------- 2026-02-13T05:48:39.009 INFO:teuthology.orchestra.run.trial024.stdout:Total 1.8 MB/s | 154 kB 00:00 2026-02-13T05:48:39.009 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction check 2026-02-13T05:48:39.014 INFO:teuthology.orchestra.run.trial024.stdout:Transaction check succeeded. 2026-02-13T05:48:39.014 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction test 2026-02-13T05:48:39.046 INFO:teuthology.orchestra.run.trial024.stdout:Transaction test succeeded. 2026-02-13T05:48:39.046 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction 2026-02-13T05:48:39.101 INFO:teuthology.orchestra.run.trial024.stdout: Preparing : 1/1 2026-02-13T05:48:39.103 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-636.g3b40640f.e 1/1 2026-02-13T05:48:39.125 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-636.g3b40640f.e 1/1 2026-02-13T05:48:39.125 INFO:teuthology.orchestra.run.trial024.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T05:48:39.125 INFO:teuthology.orchestra.run.trial024.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T05:48:39.125 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:39.407 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-636.g3b40640f.e 1/1 2026-02-13T05:48:39.407 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:39.407 INFO:teuthology.orchestra.run.trial024.stdout:Installed: 2026-02-13T05:48:39.407 INFO:teuthology.orchestra.run.trial024.stdout: ceph-immutable-object-cache-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:39.408 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:39.408 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:39.434 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install ceph-mgr 2026-02-13T05:48:39.732 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:37 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:39.796 INFO:teuthology.orchestra.run.trial024.stdout:Package ceph-mgr-2:20.2.0-636.g3b40640f.el9.x86_64 is already installed. 2026-02-13T05:48:39.815 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:39.815 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:39.816 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:39.836 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install ceph-mgr-dashboard 2026-02-13T05:48:40.139 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:38 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:40.204 INFO:teuthology.orchestra.run.trial024.stdout:Package ceph-mgr-dashboard-2:20.2.0-636.g3b40640f.el9.noarch is already installed. 2026-02-13T05:48:40.222 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:40.223 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:40.223 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:40.243 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-13T05:48:40.540 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:38 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:40.606 INFO:teuthology.orchestra.run.trial024.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-636.g3b40640f.el9.noarch is already installed. 2026-02-13T05:48:40.624 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:40.625 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:40.625 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:40.646 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install ceph-mgr-rook 2026-02-13T05:48:40.943 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:38 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:41.007 INFO:teuthology.orchestra.run.trial024.stdout:Package ceph-mgr-rook-2:20.2.0-636.g3b40640f.el9.noarch is already installed. 2026-02-13T05:48:41.026 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:41.026 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:41.026 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:41.047 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install ceph-mgr-cephadm 2026-02-13T05:48:41.343 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:39 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:41.409 INFO:teuthology.orchestra.run.trial024.stdout:Package ceph-mgr-cephadm-2:20.2.0-636.g3b40640f.el9.noarch is already installed. 2026-02-13T05:48:41.427 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:41.428 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:41.428 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:41.448 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install ceph-fuse 2026-02-13T05:48:41.748 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:39 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:41.831 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:41.832 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:41.832 INFO:teuthology.orchestra.run.trial024.stdout: Package Architecture Version Repository Size 2026-02-13T05:48:41.832 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:41.832 INFO:teuthology.orchestra.run.trial024.stdout:Installing: 2026-02-13T05:48:41.832 INFO:teuthology.orchestra.run.trial024.stdout: ceph-fuse x86_64 2:20.2.0-636.g3b40640f.el9 ceph 941 k 2026-02-13T05:48:41.832 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:41.832 INFO:teuthology.orchestra.run.trial024.stdout:Transaction Summary 2026-02-13T05:48:41.832 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:41.832 INFO:teuthology.orchestra.run.trial024.stdout:Install 1 Package 2026-02-13T05:48:41.832 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:41.833 INFO:teuthology.orchestra.run.trial024.stdout:Total download size: 941 k 2026-02-13T05:48:41.833 INFO:teuthology.orchestra.run.trial024.stdout:Installed size: 2.7 M 2026-02-13T05:48:41.833 INFO:teuthology.orchestra.run.trial024.stdout:Downloading Packages: 2026-02-13T05:48:42.349 INFO:teuthology.orchestra.run.trial024.stdout:ceph-fuse-20.2.0-636.g3b40640f.el9.x86_64.rpm 1.8 MB/s | 941 kB 00:00 2026-02-13T05:48:42.350 INFO:teuthology.orchestra.run.trial024.stdout:-------------------------------------------------------------------------------- 2026-02-13T05:48:42.350 INFO:teuthology.orchestra.run.trial024.stdout:Total 1.8 MB/s | 941 kB 00:00 2026-02-13T05:48:42.350 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction check 2026-02-13T05:48:42.355 INFO:teuthology.orchestra.run.trial024.stdout:Transaction check succeeded. 2026-02-13T05:48:42.355 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction test 2026-02-13T05:48:42.389 INFO:teuthology.orchestra.run.trial024.stdout:Transaction test succeeded. 2026-02-13T05:48:42.389 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction 2026-02-13T05:48:42.479 INFO:teuthology.orchestra.run.trial024.stdout: Preparing : 1/1 2026-02-13T05:48:42.496 INFO:teuthology.orchestra.run.trial024.stdout: Installing : ceph-fuse-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:42.711 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: ceph-fuse-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:42.767 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : ceph-fuse-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:42.768 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:42.768 INFO:teuthology.orchestra.run.trial024.stdout:Installed: 2026-02-13T05:48:42.768 INFO:teuthology.orchestra.run.trial024.stdout: ceph-fuse-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:42.768 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:42.768 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:42.795 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install ceph-volume 2026-02-13T05:48:43.098 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:41 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:43.163 INFO:teuthology.orchestra.run.trial024.stdout:Package ceph-volume-2:20.2.0-636.g3b40640f.el9.noarch is already installed. 2026-02-13T05:48:43.181 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:43.182 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:43.182 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:43.203 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install librados-devel 2026-02-13T05:48:43.501 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:41 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:43.586 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:43.586 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:43.587 INFO:teuthology.orchestra.run.trial024.stdout: Package Arch Version Repo Size 2026-02-13T05:48:43.587 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:43.587 INFO:teuthology.orchestra.run.trial024.stdout:Installing: 2026-02-13T05:48:43.587 INFO:teuthology.orchestra.run.trial024.stdout: librados-devel x86_64 2:20.2.0-636.g3b40640f.el9 ceph 126 k 2026-02-13T05:48:43.587 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:43.587 INFO:teuthology.orchestra.run.trial024.stdout:Transaction Summary 2026-02-13T05:48:43.587 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:43.587 INFO:teuthology.orchestra.run.trial024.stdout:Install 1 Package 2026-02-13T05:48:43.587 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:43.587 INFO:teuthology.orchestra.run.trial024.stdout:Total download size: 126 k 2026-02-13T05:48:43.588 INFO:teuthology.orchestra.run.trial024.stdout:Installed size: 449 k 2026-02-13T05:48:43.588 INFO:teuthology.orchestra.run.trial024.stdout:Downloading Packages: 2026-02-13T05:48:43.940 INFO:teuthology.orchestra.run.trial024.stdout:librados-devel-20.2.0-636.g3b40640f.el9.x86_64. 356 kB/s | 126 kB 00:00 2026-02-13T05:48:43.941 INFO:teuthology.orchestra.run.trial024.stdout:-------------------------------------------------------------------------------- 2026-02-13T05:48:43.941 INFO:teuthology.orchestra.run.trial024.stdout:Total 354 kB/s | 126 kB 00:00 2026-02-13T05:48:43.941 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction check 2026-02-13T05:48:43.944 INFO:teuthology.orchestra.run.trial024.stdout:Transaction check succeeded. 2026-02-13T05:48:43.944 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction test 2026-02-13T05:48:43.976 INFO:teuthology.orchestra.run.trial024.stdout:Transaction test succeeded. 2026-02-13T05:48:43.977 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction 2026-02-13T05:48:44.031 INFO:teuthology.orchestra.run.trial024.stdout: Preparing : 1/1 2026-02-13T05:48:44.048 INFO:teuthology.orchestra.run.trial024.stdout: Installing : librados-devel-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:44.129 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: librados-devel-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:44.187 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : librados-devel-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:44.187 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:44.187 INFO:teuthology.orchestra.run.trial024.stdout:Installed: 2026-02-13T05:48:44.187 INFO:teuthology.orchestra.run.trial024.stdout: librados-devel-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:44.187 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:44.187 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:44.214 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install libcephfs2 2026-02-13T05:48:44.516 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:42 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:44.582 INFO:teuthology.orchestra.run.trial024.stdout:Package libcephfs2-2:20.2.0-636.g3b40640f.el9.x86_64 is already installed. 2026-02-13T05:48:44.601 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:44.601 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:44.601 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:44.623 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install libcephfs-devel 2026-02-13T05:48:44.921 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:42 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:45.004 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:45.005 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:45.005 INFO:teuthology.orchestra.run.trial024.stdout: Package Arch Version Repo Size 2026-02-13T05:48:45.005 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:45.006 INFO:teuthology.orchestra.run.trial024.stdout:Installing: 2026-02-13T05:48:45.006 INFO:teuthology.orchestra.run.trial024.stdout: libcephfs-devel x86_64 2:20.2.0-636.g3b40640f.el9 ceph 34 k 2026-02-13T05:48:45.006 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:45.006 INFO:teuthology.orchestra.run.trial024.stdout:Transaction Summary 2026-02-13T05:48:45.006 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:45.006 INFO:teuthology.orchestra.run.trial024.stdout:Install 1 Package 2026-02-13T05:48:45.006 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:45.006 INFO:teuthology.orchestra.run.trial024.stdout:Total download size: 34 k 2026-02-13T05:48:45.006 INFO:teuthology.orchestra.run.trial024.stdout:Installed size: 155 k 2026-02-13T05:48:45.006 INFO:teuthology.orchestra.run.trial024.stdout:Downloading Packages: 2026-02-13T05:48:45.315 INFO:teuthology.orchestra.run.trial024.stdout:libcephfs-devel-20.2.0-636.g3b40640f.el9.x86_64 111 kB/s | 34 kB 00:00 2026-02-13T05:48:45.315 INFO:teuthology.orchestra.run.trial024.stdout:-------------------------------------------------------------------------------- 2026-02-13T05:48:45.315 INFO:teuthology.orchestra.run.trial024.stdout:Total 111 kB/s | 34 kB 00:00 2026-02-13T05:48:45.316 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction check 2026-02-13T05:48:45.318 INFO:teuthology.orchestra.run.trial024.stdout:Transaction check succeeded. 2026-02-13T05:48:45.318 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction test 2026-02-13T05:48:45.321 INFO:teuthology.orchestra.run.trial024.stdout:Transaction test succeeded. 2026-02-13T05:48:45.321 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction 2026-02-13T05:48:45.342 INFO:teuthology.orchestra.run.trial024.stdout: Preparing : 1/1 2026-02-13T05:48:45.358 INFO:teuthology.orchestra.run.trial024.stdout: Installing : libcephfs-devel-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:45.415 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:45.472 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : libcephfs-devel-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:45.472 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:45.472 INFO:teuthology.orchestra.run.trial024.stdout:Installed: 2026-02-13T05:48:45.472 INFO:teuthology.orchestra.run.trial024.stdout: libcephfs-devel-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:45.472 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:45.472 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:45.500 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install librados2 2026-02-13T05:48:45.804 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:43 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:45.869 INFO:teuthology.orchestra.run.trial024.stdout:Package librados2-2:20.2.0-636.g3b40640f.el9.x86_64 is already installed. 2026-02-13T05:48:45.887 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:45.888 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:45.888 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:45.910 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install librbd1 2026-02-13T05:48:46.213 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:44 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:46.277 INFO:teuthology.orchestra.run.trial024.stdout:Package librbd1-2:20.2.0-636.g3b40640f.el9.x86_64 is already installed. 2026-02-13T05:48:46.296 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:46.296 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:46.296 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:46.317 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install python3-rados 2026-02-13T05:48:46.621 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:44 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:46.686 INFO:teuthology.orchestra.run.trial024.stdout:Package python3-rados-2:20.2.0-636.g3b40640f.el9.x86_64 is already installed. 2026-02-13T05:48:46.704 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:46.705 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:46.705 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:46.726 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install python3-rgw 2026-02-13T05:48:47.029 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:45 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:47.094 INFO:teuthology.orchestra.run.trial024.stdout:Package python3-rgw-2:20.2.0-636.g3b40640f.el9.x86_64 is already installed. 2026-02-13T05:48:47.113 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:47.113 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:47.113 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:47.135 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install python3-cephfs 2026-02-13T05:48:47.436 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:45 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:47.501 INFO:teuthology.orchestra.run.trial024.stdout:Package python3-cephfs-2:20.2.0-636.g3b40640f.el9.x86_64 is already installed. 2026-02-13T05:48:47.519 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:47.520 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:47.520 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:47.541 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install python3-rbd 2026-02-13T05:48:47.845 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:45 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:47.910 INFO:teuthology.orchestra.run.trial024.stdout:Package python3-rbd-2:20.2.0-636.g3b40640f.el9.x86_64 is already installed. 2026-02-13T05:48:47.928 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:47.929 INFO:teuthology.orchestra.run.trial024.stdout:Nothing to do. 2026-02-13T05:48:47.929 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:47.950 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install rbd-fuse 2026-02-13T05:48:48.254 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:46 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:48.337 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:48.338 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:48.338 INFO:teuthology.orchestra.run.trial024.stdout: Package Architecture Version Repository Size 2026-02-13T05:48:48.338 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:48.339 INFO:teuthology.orchestra.run.trial024.stdout:Installing: 2026-02-13T05:48:48.339 INFO:teuthology.orchestra.run.trial024.stdout: rbd-fuse x86_64 2:20.2.0-636.g3b40640f.el9 ceph 91 k 2026-02-13T05:48:48.339 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:48.339 INFO:teuthology.orchestra.run.trial024.stdout:Transaction Summary 2026-02-13T05:48:48.339 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:48.339 INFO:teuthology.orchestra.run.trial024.stdout:Install 1 Package 2026-02-13T05:48:48.339 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:48.339 INFO:teuthology.orchestra.run.trial024.stdout:Total download size: 91 k 2026-02-13T05:48:48.339 INFO:teuthology.orchestra.run.trial024.stdout:Installed size: 238 k 2026-02-13T05:48:48.339 INFO:teuthology.orchestra.run.trial024.stdout:Downloading Packages: 2026-02-13T05:48:48.499 INFO:teuthology.orchestra.run.trial024.stdout:rbd-fuse-20.2.0-636.g3b40640f.el9.x86_64.rpm 571 kB/s | 91 kB 00:00 2026-02-13T05:48:48.499 INFO:teuthology.orchestra.run.trial024.stdout:-------------------------------------------------------------------------------- 2026-02-13T05:48:48.499 INFO:teuthology.orchestra.run.trial024.stdout:Total 568 kB/s | 91 kB 00:00 2026-02-13T05:48:48.499 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction check 2026-02-13T05:48:48.504 INFO:teuthology.orchestra.run.trial024.stdout:Transaction check succeeded. 2026-02-13T05:48:48.504 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction test 2026-02-13T05:48:48.536 INFO:teuthology.orchestra.run.trial024.stdout:Transaction test succeeded. 2026-02-13T05:48:48.537 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction 2026-02-13T05:48:48.588 INFO:teuthology.orchestra.run.trial024.stdout: Preparing : 1/1 2026-02-13T05:48:48.605 INFO:teuthology.orchestra.run.trial024.stdout: Installing : rbd-fuse-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:48.683 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: rbd-fuse-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:48.740 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : rbd-fuse-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:48.740 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:48.740 INFO:teuthology.orchestra.run.trial024.stdout:Installed: 2026-02-13T05:48:48.740 INFO:teuthology.orchestra.run.trial024.stdout: rbd-fuse-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:48.740 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:48.740 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:48.768 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install rbd-mirror 2026-02-13T05:48:49.067 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:47 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:49.150 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:49.151 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:49.151 INFO:teuthology.orchestra.run.trial024.stdout: Package Arch Version Repo Size 2026-02-13T05:48:49.151 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:49.151 INFO:teuthology.orchestra.run.trial024.stdout:Installing: 2026-02-13T05:48:49.151 INFO:teuthology.orchestra.run.trial024.stdout: rbd-mirror x86_64 2:20.2.0-636.g3b40640f.el9 ceph 2.9 M 2026-02-13T05:48:49.152 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:49.152 INFO:teuthology.orchestra.run.trial024.stdout:Transaction Summary 2026-02-13T05:48:49.152 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:49.152 INFO:teuthology.orchestra.run.trial024.stdout:Install 1 Package 2026-02-13T05:48:49.152 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:49.152 INFO:teuthology.orchestra.run.trial024.stdout:Total download size: 2.9 M 2026-02-13T05:48:49.152 INFO:teuthology.orchestra.run.trial024.stdout:Installed size: 11 M 2026-02-13T05:48:49.152 INFO:teuthology.orchestra.run.trial024.stdout:Downloading Packages: 2026-02-13T05:48:49.463 INFO:teuthology.orchestra.run.trial024.stdout:rbd-mirror-20.2.0-636.g3b40640f.el9.x86_64.rpm 9.4 MB/s | 2.9 MB 00:00 2026-02-13T05:48:49.463 INFO:teuthology.orchestra.run.trial024.stdout:-------------------------------------------------------------------------------- 2026-02-13T05:48:49.463 INFO:teuthology.orchestra.run.trial024.stdout:Total 9.3 MB/s | 2.9 MB 00:00 2026-02-13T05:48:49.464 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction check 2026-02-13T05:48:49.468 INFO:teuthology.orchestra.run.trial024.stdout:Transaction check succeeded. 2026-02-13T05:48:49.469 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction test 2026-02-13T05:48:49.509 INFO:teuthology.orchestra.run.trial024.stdout:Transaction test succeeded. 2026-02-13T05:48:49.509 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction 2026-02-13T05:48:49.691 INFO:teuthology.orchestra.run.trial024.stdout: Preparing : 1/1 2026-02-13T05:48:49.693 INFO:teuthology.orchestra.run.trial024.stdout: Installing : rbd-mirror-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:49.715 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: rbd-mirror-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:49.716 INFO:teuthology.orchestra.run.trial024.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T05:48:49.716 INFO:teuthology.orchestra.run.trial024.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T05:48:49.716 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T05:48:49.716 INFO:teuthology.orchestra.run.trial024.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T05:48:49.716 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:50.028 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : rbd-mirror-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:50.029 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:50.029 INFO:teuthology.orchestra.run.trial024.stdout:Installed: 2026-02-13T05:48:50.029 INFO:teuthology.orchestra.run.trial024.stdout: rbd-mirror-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:50.029 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:50.029 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:50.057 DEBUG:teuthology.orchestra.run.trial024:> sudo yum -y install rbd-nbd 2026-02-13T05:48:50.356 INFO:teuthology.orchestra.run.trial024.stdout:Last metadata expiration check: 0:00:48 ago on Fri 13 Feb 2026 05:48:02 AM UTC. 2026-02-13T05:48:50.439 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-13T05:48:50.440 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:50.440 INFO:teuthology.orchestra.run.trial024.stdout: Package Architecture Version Repository Size 2026-02-13T05:48:50.441 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:50.441 INFO:teuthology.orchestra.run.trial024.stdout:Installing: 2026-02-13T05:48:50.441 INFO:teuthology.orchestra.run.trial024.stdout: rbd-nbd x86_64 2:20.2.0-636.g3b40640f.el9 ceph 180 k 2026-02-13T05:48:50.441 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:50.441 INFO:teuthology.orchestra.run.trial024.stdout:Transaction Summary 2026-02-13T05:48:50.441 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-13T05:48:50.441 INFO:teuthology.orchestra.run.trial024.stdout:Install 1 Package 2026-02-13T05:48:50.441 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:50.441 INFO:teuthology.orchestra.run.trial024.stdout:Total download size: 180 k 2026-02-13T05:48:50.441 INFO:teuthology.orchestra.run.trial024.stdout:Installed size: 498 k 2026-02-13T05:48:50.441 INFO:teuthology.orchestra.run.trial024.stdout:Downloading Packages: 2026-02-13T05:48:50.641 INFO:teuthology.orchestra.run.trial024.stdout:rbd-nbd-20.2.0-636.g3b40640f.el9.x86_64.rpm 897 kB/s | 180 kB 00:00 2026-02-13T05:48:50.642 INFO:teuthology.orchestra.run.trial024.stdout:-------------------------------------------------------------------------------- 2026-02-13T05:48:50.642 INFO:teuthology.orchestra.run.trial024.stdout:Total 893 kB/s | 180 kB 00:00 2026-02-13T05:48:50.642 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction check 2026-02-13T05:48:50.646 INFO:teuthology.orchestra.run.trial024.stdout:Transaction check succeeded. 2026-02-13T05:48:50.646 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction test 2026-02-13T05:48:50.678 INFO:teuthology.orchestra.run.trial024.stdout:Transaction test succeeded. 2026-02-13T05:48:50.679 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction 2026-02-13T05:48:50.734 INFO:teuthology.orchestra.run.trial024.stdout: Preparing : 1/1 2026-02-13T05:48:50.751 INFO:teuthology.orchestra.run.trial024.stdout: Installing : rbd-nbd-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:50.836 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: rbd-nbd-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:50.893 INFO:teuthology.orchestra.run.trial024.stdout: Verifying : rbd-nbd-2:20.2.0-636.g3b40640f.el9.x86_64 1/1 2026-02-13T05:48:50.893 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:50.893 INFO:teuthology.orchestra.run.trial024.stdout:Installed: 2026-02-13T05:48:50.893 INFO:teuthology.orchestra.run.trial024.stdout: rbd-nbd-2:20.2.0-636.g3b40640f.el9.x86_64 2026-02-13T05:48:50.893 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-13T05:48:50.893 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-13T05:48:50.924 DEBUG:teuthology.parallel:result is None 2026-02-13T05:48:50.925 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T05:48:51.094 DEBUG:teuthology.orchestra.run.trial024:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T05:48:51.116 INFO:teuthology.orchestra.run.trial024.stdout:20.2.0-636.g3b40640f.el9 2026-02-13T05:48:51.117 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-636.g3b40640f.el9 2026-02-13T05:48:51.117 INFO:teuthology.task.install:The correct ceph version 20.2.0-636.g3b40640f is installed. 2026-02-13T05:48:51.119 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T05:48:51.119 DEBUG:teuthology.orchestra.run.trial024:> set -ex 2026-02-13T05:48:51.120 DEBUG:teuthology.orchestra.run.trial024:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T05:48:51.181 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T05:48:51.181 DEBUG:teuthology.orchestra.run.trial024:> set -ex 2026-02-13T05:48:51.181 DEBUG:teuthology.orchestra.run.trial024:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T05:48:51.247 DEBUG:teuthology.orchestra.run.trial024:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T05:48:51.309 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T05:48:51.310 DEBUG:teuthology.orchestra.run.trial024:> set -ex 2026-02-13T05:48:51.310 DEBUG:teuthology.orchestra.run.trial024:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T05:48:51.374 DEBUG:teuthology.orchestra.run.trial024:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T05:48:51.439 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T05:48:51.440 DEBUG:teuthology.orchestra.run.trial024:> set -ex 2026-02-13T05:48:51.440 DEBUG:teuthology.orchestra.run.trial024:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T05:48:51.503 DEBUG:teuthology.orchestra.run.trial024:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T05:48:51.567 INFO:teuthology.run_tasks:Running task workunit... 2026-02-13T05:48:51.602 INFO:tasks.workunit:Pulling workunits from ref 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T05:48:51.603 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-13T05:48:51.603 INFO:tasks.workunit:timeout=3h 2026-02-13T05:48:51.603 INFO:tasks.workunit:cleanup=True 2026-02-13T05:48:51.604 DEBUG:teuthology.orchestra.run.trial024:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-13T05:48:51.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T05:48:51.624 INFO:teuthology.orchestra.run.trial024.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-13T05:48:51.624 DEBUG:teuthology.orchestra.run.trial024:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-13T05:48:51.680 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-13T05:48:51.681 DEBUG:teuthology.orchestra.run.trial024:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-13T05:48:51.738 DEBUG:teuthology.orchestra.run.trial024:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T05:48:51.802 INFO:tasks.workunit.client.0.trial024.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-13T05:49:11.175 INFO:tasks.workunit.client.0.trial024.stderr:Note: switching to '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb'. 2026-02-13T05:49:11.175 INFO:tasks.workunit.client.0.trial024.stderr: 2026-02-13T05:49:11.175 INFO:tasks.workunit.client.0.trial024.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-13T05:49:11.176 INFO:tasks.workunit.client.0.trial024.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-13T05:49:11.176 INFO:tasks.workunit.client.0.trial024.stderr:state without impacting any branches by switching back to a branch. 2026-02-13T05:49:11.176 INFO:tasks.workunit.client.0.trial024.stderr: 2026-02-13T05:49:11.176 INFO:tasks.workunit.client.0.trial024.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-13T05:49:11.176 INFO:tasks.workunit.client.0.trial024.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-13T05:49:11.176 INFO:tasks.workunit.client.0.trial024.stderr: 2026-02-13T05:49:11.176 INFO:tasks.workunit.client.0.trial024.stderr: git switch -c 2026-02-13T05:49:11.176 INFO:tasks.workunit.client.0.trial024.stderr: 2026-02-13T05:49:11.176 INFO:tasks.workunit.client.0.trial024.stderr:Or undo this operation with: 2026-02-13T05:49:11.176 INFO:tasks.workunit.client.0.trial024.stderr: 2026-02-13T05:49:11.176 INFO:tasks.workunit.client.0.trial024.stderr: git switch - 2026-02-13T05:49:11.177 INFO:tasks.workunit.client.0.trial024.stderr: 2026-02-13T05:49:11.177 INFO:tasks.workunit.client.0.trial024.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-13T05:49:11.177 INFO:tasks.workunit.client.0.trial024.stderr: 2026-02-13T05:49:11.177 INFO:tasks.workunit.client.0.trial024.stderr:HEAD is now at 3b40640f18f Merge branch 'wip-74888-tentacle' of https://github.com/aainscow/ceph into wip-bharath17-testing-2026-02-12-0618-tentacle 2026-02-13T05:49:11.183 DEBUG:teuthology.orchestra.run.trial024:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-13T05:49:11.244 DEBUG:teuthology.orchestra.run.trial024:> set -ex 2026-02-13T05:49:11.244 DEBUG:teuthology.orchestra.run.trial024:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-13T05:49:11.302 INFO:tasks.workunit:Running workunits matching erasure-code on client.0... 2026-02-13T05:49:11.303 INFO:tasks.workunit:Running workunit erasure-code/test-erasure-code-plugins.sh... 2026-02-13T05:49:11.303 DEBUG:teuthology.orchestra.run.trial024:workunit test erasure-code/test-erasure-code-plugins.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh 2026-02-13T05:49:11.364 INFO:tasks.workunit.client.0.trial024.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh 2026-02-13T05:49:11.364 INFO:tasks.workunit.client.0.trial024.stderr:++ TIMEOUT=300 2026-02-13T05:49:11.364 INFO:tasks.workunit.client.0.trial024.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2026-02-13T05:49:11.364 INFO:tasks.workunit.client.0.trial024.stderr:++ MAX_TIMEOUT=15 2026-02-13T05:49:11.364 INFO:tasks.workunit.client.0.trial024.stderr:++ PG_NUM=4 2026-02-13T05:49:11.364 INFO:tasks.workunit.client.0.trial024.stderr:++ TMPDIR=/tmp 2026-02-13T05:49:11.364 INFO:tasks.workunit.client.0.trial024.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2026-02-13T05:49:11.365 INFO:tasks.workunit.client.0.trial024.stderr:++ TESTDIR=/home/ubuntu/cephtest 2026-02-13T05:49:11.365 INFO:tasks.workunit.client.0.trial024.stderr:+++ uname 2026-02-13T05:49:11.366 INFO:tasks.workunit.client.0.trial024.stderr:++ '[' Linux = FreeBSD ']' 2026-02-13T05:49:11.366 INFO:tasks.workunit.client.0.trial024.stderr:++ SED=sed 2026-02-13T05:49:11.366 INFO:tasks.workunit.client.0.trial024.stderr:++ AWK=awk 2026-02-13T05:49:11.366 INFO:tasks.workunit.client.0.trial024.stderr:+++ stty -a 2026-02-13T05:49:11.367 INFO:tasks.workunit.client.0.trial024.stderr:+++ head -1 2026-02-13T05:49:11.367 INFO:tasks.workunit.client.0.trial024.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2026-02-13T05:49:11.367 INFO:tasks.workunit.client.0.trial024.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T05:49:11.367 INFO:tasks.workunit.client.0.trial024.stderr:++ termwidth= 2026-02-13T05:49:11.367 INFO:tasks.workunit.client.0.trial024.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2026-02-13T05:49:11.367 INFO:tasks.workunit.client.0.trial024.stderr:++ DIFFCOLOPTS='-y ' 2026-02-13T05:49:11.367 INFO:tasks.workunit.client.0.trial024.stderr:++ KERNCORE=kernel.core_pattern 2026-02-13T05:49:11.367 INFO:tasks.workunit.client.0.trial024.stderr:++ EXTRA_OPTS= 2026-02-13T05:49:11.368 INFO:tasks.workunit.client.0.trial024.stderr:++ test '' = TESTS 2026-02-13T05:49:11.368 INFO:tasks.workunit.client.0.trial024.stderr:++ uname -m 2026-02-13T05:49:11.370 INFO:tasks.workunit.client.0.trial024.stderr:+ arch=x86_64 2026-02-13T05:49:11.371 INFO:tasks.workunit.client.0.trial024.stderr:+ case $arch in 2026-02-13T05:49:11.371 INFO:tasks.workunit.client.0.trial024.stderr:+ legacy_jerasure_plugins=(jerasure_generic jerasure_sse3 jerasure_sse4) 2026-02-13T05:49:11.371 INFO:tasks.workunit.client.0.trial024.stderr:+ legacy_shec_plugins=(shec_generic shec_sse3 shec_sse4) 2026-02-13T05:49:11.371 INFO:tasks.workunit.client.0.trial024.stderr:+ plugins=(jerasure shec lrc isa) 2026-02-13T05:49:11.371 INFO:tasks.workunit.client.0.trial024.stderr:+ main test-erasure-code-plugins 2026-02-13T05:49:11.371 INFO:tasks.workunit.client.0.trial024.stderr:+ local dir=td/test-erasure-code-plugins 2026-02-13T05:49:11.371 INFO:tasks.workunit.client.0.trial024.stderr:+ shift 2026-02-13T05:49:11.371 INFO:tasks.workunit.client.0.trial024.stderr:+ shopt -s -o xtrace 2026-02-13T05:49:11.371 INFO:tasks.workunit.client.0.trial024.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T05:49:11.371 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-13T05:49:11.371 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-13T05:49:11.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-13T05:49:11.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-13T05:49:11.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-13T05:49:11.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-13T05:49:11.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-13T05:49:11.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-13T05:49:11.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/test-erasure-code-plugins 2026-02-13T05:49:11.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:26: run: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:11.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:27: run: shift 2026-02-13T05:49:11.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:29: run: export CEPH_MON=127.0.0.1:17110 2026-02-13T05:49:11.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:29: run: CEPH_MON=127.0.0.1:17110 2026-02-13T05:49:11.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:30: run: export CEPH_ARGS 2026-02-13T05:49:11.373 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:31: run: uuidgen 2026-02-13T05:49:11.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:31: run: CEPH_ARGS+='--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none ' 2026-02-13T05:49:11.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:32: run: CEPH_ARGS+='--mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:11.375 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:34: run: set 2026-02-13T05:49:11.375 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:34: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T05:49:11.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:34: run: local 'funcs=TEST_ec_profile_warning 2026-02-13T05:49:11.375 INFO:tasks.workunit.client.0.trial024.stderr:TEST_preload_no_warning 2026-02-13T05:49:11.375 INFO:tasks.workunit.client.0.trial024.stderr:TEST_preload_no_warning_default 2026-02-13T05:49:11.375 INFO:tasks.workunit.client.0.trial024.stderr:TEST_preload_warning' 2026-02-13T05:49:11.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:35: run: for func in $funcs 2026-02-13T05:49:11.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:36: run: TEST_ec_profile_warning td/test-erasure-code-plugins 2026-02-13T05:49:11.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:92: TEST_ec_profile_warning: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:94: TEST_ec_profile_warning: setup td/test-erasure-code-plugins 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:11.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:11.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:11.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:11.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:11.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:11.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:11.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:11.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:11.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:11.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:11.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:11.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:11.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:11.380 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:11.380 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:11.380 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:11.381 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:11.381 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:11.381 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:11.381 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-13T05:49:11.382 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:11.382 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:11.382 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:11.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18932 2026-02-13T05:49:11.383 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:11.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T05:49:11.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T05:49:11.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:11.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-13T05:49:11.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:95: TEST_ec_profile_warning: run_mon td/test-erasure-code-plugins a 2026-02-13T05:49:11.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:11.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:11.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:11.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:11.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-13T05:49:11.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins 2026-02-13T05:49:11.405 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:11.405 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:11.405 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:11.405 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:11.405 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:11.406 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:11.406 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:11.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:49:11.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:11.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:11.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:11.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:11.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:11.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:11.434 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:11.434 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:11.434 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:11.434 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:11.434 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:11.434 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:11.435 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:11.435 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:11.435 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get fsid 2026-02-13T05:49:11.479 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:11.479 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:11.479 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:11.479 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:11.479 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:11.479 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:11.479 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:11.479 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:11.479 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:11.479 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:11.480 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:11.480 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:11.480 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:11.480 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:11.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:96: TEST_ec_profile_warning: run_mgr td/test-erasure-code-plugins x 2026-02-13T05:49:11.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:11.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:11.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:11.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:11.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-13T05:49:11.525 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:11.626 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:11.626 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:11.626 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:11.626 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:11.626 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:11.626 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:11.626 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:11.627 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:11.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:11.643 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:97: TEST_ec_profile_warning: seq 0 2 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:97: TEST_ec_profile_warning: for id in $(seq 0 2) 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:98: TEST_ec_profile_warning: run_osd td/test-erasure-code-plugins 0 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-13T05:49:11.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:11.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:11.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:11.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:11.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:11.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:49:11.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-13T05:49:11.646 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:11.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=35b85841-debf-4e37-a8a8-7ae7e092d1d5 2026-02-13T05:49:11.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 35b85841-debf-4e37-a8a8-7ae7e092d1d5' 2026-02-13T05:49:11.647 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 35b85841-debf-4e37-a8a8-7ae7e092d1d5 2026-02-13T05:49:11.647 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:11.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBXu45p5eM1JxAA9IKmEn3fANcfXU0rBD986A== 2026-02-13T05:49:11.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBXu45p5eM1JxAA9IKmEn3fANcfXU0rBD986A=="}' 2026-02-13T05:49:11.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 35b85841-debf-4e37-a8a8-7ae7e092d1d5 -i td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:11.762 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:11.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:11.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBXu45p5eM1JxAA9IKmEn3fANcfXU0rBD986A== --osd-uuid 35b85841-debf-4e37-a8a8-7ae7e092d1d5 2026-02-13T05:49:11.785 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:11.785+0000 7fbfd356b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:11.787 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:11.787+0000 7fbfd356b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:11.788 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:11.788+0000 7fbfd356b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:11.789 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:11.788+0000 7fbfd356b900 -1 bdev(0x555a81790c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:11.789 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:11.788+0000 7fbfd356b900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-13T05:49:12.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-13T05:49:12.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:12.256 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:12.256 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:12.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:12.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:12.362 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:12.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:49:12.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:12.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:12.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:12.378 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:12.378+0000 7f4bebbe0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:12.379 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:12.379+0000 7f4bebbe0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:12.380 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:12.380+0000 7f4bebbe0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:12.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:12.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:12.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:12.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:12.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:12.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:12.463 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:12.463 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:12.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:12.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:12.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:12.571 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:12.570+0000 7f4bebbe0900 -1 Falling back to public interface 2026-02-13T05:49:12.911 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:12.910+0000 7f4bebbe0900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:13.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:13.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:13.564 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:13.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:13.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:13.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:13.661 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3953797410,v1:127.0.0.1:6801/3953797410] [v2:127.0.0.1:6802/3953797410,v1:127.0.0.1:6803/3953797410] exists,up 35b85841-debf-4e37-a8a8-7ae7e092d1d5 2026-02-13T05:49:13.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:13.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:13.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:13.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:97: TEST_ec_profile_warning: for id in $(seq 0 2) 2026-02-13T05:49:13.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:98: TEST_ec_profile_warning: run_osd td/test-erasure-code-plugins 1 2026-02-13T05:49:13.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:13.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:13.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:49:13.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:13.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/1 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/1' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/1/journal' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:13.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:13.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:13.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:13.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:13.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:13.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:13.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:49:13.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/1 2026-02-13T05:49:13.665 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:13.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=fcba22b1-5c64-4e6b-a7ae-365c22b36853 2026-02-13T05:49:13.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 fcba22b1-5c64-4e6b-a7ae-365c22b36853' 2026-02-13T05:49:13.665 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 fcba22b1-5c64-4e6b-a7ae-365c22b36853 2026-02-13T05:49:13.666 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:13.676 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBZu45pUjxQKBAAVlbrVBN9iXXu7KhEvHSw8Q== 2026-02-13T05:49:13.676 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBZu45pUjxQKBAAVlbrVBN9iXXu7KhEvHSw8Q=="}' 2026-02-13T05:49:13.676 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new fcba22b1-5c64-4e6b-a7ae-365c22b36853 -i td/test-erasure-code-plugins/1/new.json 2026-02-13T05:49:13.776 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:13.783 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/1/new.json 2026-02-13T05:49:13.784 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/1 --osd-journal=td/test-erasure-code-plugins/1/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBZu45pUjxQKBAAVlbrVBN9iXXu7KhEvHSw8Q== --osd-uuid fcba22b1-5c64-4e6b-a7ae-365c22b36853 2026-02-13T05:49:13.801 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:13.801+0000 7f370a701900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:13.803 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:13.803+0000 7f370a701900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:13.804 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:13.804+0000 7f370a701900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:13.805 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:13.804+0000 7f370a701900 -1 bdev(0x560326ab2c00 td/test-erasure-code-plugins/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:13.805 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:13.804+0000 7f370a701900 -1 bluestore(td/test-erasure-code-plugins/1) _read_fsid unparsable uuid 2026-02-13T05:49:14.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/1/keyring 2026-02-13T05:49:14.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:14.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:49:14.182 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:49:14.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:14.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:49:14.495 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:49:14.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/1 --osd-journal=td/test-erasure-code-plugins/1/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:49:14.496 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:14.496 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:14.496 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:14.510 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:14.510+0000 7f4fc7a72900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:14.512 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:14.512+0000 7f4fc7a72900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:14.513 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:14.512+0000 7f4fc7a72900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:14.671 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:14.670+0000 7f4fc7a72900 -1 Falling back to public interface 2026-02-13T05:49:14.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:49:14.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:14.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:49:14.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:14.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:14.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:14.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:14.719 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:14.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:14.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:49:14.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:15.026 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:15.024+0000 7f4fc7a72900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:49:15.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:15.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:15.943 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:15.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:15.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:15.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:49:16.165 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3778589132,v1:127.0.0.1:6811/3778589132] [v2:127.0.0.1:6812/3778589132,v1:127.0.0.1:6813/3778589132] exists,up fcba22b1-5c64-4e6b-a7ae-365c22b36853 2026-02-13T05:49:16.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:97: TEST_ec_profile_warning: for id in $(seq 0 2) 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:98: TEST_ec_profile_warning: run_osd td/test-erasure-code-plugins 2 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/2 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:16.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/2' 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/2/journal' 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:16.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:16.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:16.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:16.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:16.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:16.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:16.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:16.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:16.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:49:16.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/2 2026-02-13T05:49:16.171 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:16.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2903e1df-2f90-4d7a-8c71-04c4f585892a 2026-02-13T05:49:16.172 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 2903e1df-2f90-4d7a-8c71-04c4f585892a 2026-02-13T05:49:16.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 2903e1df-2f90-4d7a-8c71-04c4f585892a' 2026-02-13T05:49:16.172 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:16.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBcu45pCDjGChAAiEi8hqmNS5TsMOl20+FJrw== 2026-02-13T05:49:16.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBcu45pCDjGChAAiEi8hqmNS5TsMOl20+FJrw=="}' 2026-02-13T05:49:16.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2903e1df-2f90-4d7a-8c71-04c4f585892a -i td/test-erasure-code-plugins/2/new.json 2026-02-13T05:49:16.407 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:49:16.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/2/new.json 2026-02-13T05:49:16.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/2 --osd-journal=td/test-erasure-code-plugins/2/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBcu45pCDjGChAAiEi8hqmNS5TsMOl20+FJrw== --osd-uuid 2903e1df-2f90-4d7a-8c71-04c4f585892a 2026-02-13T05:49:16.432 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:16.431+0000 7feb36af6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:16.434 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:16.432+0000 7feb36af6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:16.435 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:16.433+0000 7feb36af6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:16.435 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:16.434+0000 7feb36af6900 -1 bdev(0x562bcb70ec00 td/test-erasure-code-plugins/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:16.435 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:16.434+0000 7feb36af6900 -1 bluestore(td/test-erasure-code-plugins/2) _read_fsid unparsable uuid 2026-02-13T05:49:16.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/2/keyring 2026-02-13T05:49:16.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:16.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:49:16.754 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:49:16.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:17.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:49:17.067 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:49:17.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/2 --osd-journal=td/test-erasure-code-plugins/2/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:49:17.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:17.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:17.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:17.083 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:17.082+0000 7f04b2851900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:17.084 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:17.083+0000 7f04b2851900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:17.085 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:17.084+0000 7f04b2851900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:17.275 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:17.274+0000 7f04b2851900 -1 Falling back to public interface 2026-02-13T05:49:17.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:49:17.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:17.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:49:17.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:17.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:17.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:17.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:17.288 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:17.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:17.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:49:17.510 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:17.600 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:17.599+0000 7f04b2851900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:49:18.511 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:18.511 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:18.512 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:18.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:18.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:18.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:49:18.733 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2478863343,v1:127.0.0.1:6819/2478863343] [v2:127.0.0.1:6820/2478863343,v1:127.0.0.1:6821/2478863343] exists,up 2903e1df-2f90-4d7a-8c71-04c4f585892a 2026-02-13T05:49:18.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:18.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:18.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:18.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:100: TEST_ec_profile_warning: create_rbd_pool 2026-02-13T05:49:18.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-13T05:49:18.949 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' does not exist 2026-02-13T05:49:18.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-13T05:49:18.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:49:19.226 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:49:19.234 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:49:20.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-13T05:49:20.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:101: TEST_ec_profile_warning: wait_for_clean 2026-02-13T05:49:20.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:49:20.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:49:20.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:49:20.519 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:49:20.520 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:49:20.520 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:49:20.520 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:49:20.520 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:49:20.520 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:49:20.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:49:20.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:49:20.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:49:20.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:49:20.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:49:20.601 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:49:20.820 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:49:20.820 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:49:20.820 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:49:20.820 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:49:20.820 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:49:20.821 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:49:20.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-13T05:49:20.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-13T05:49:20.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484' 2026-02-13T05:49:20.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:49:20.883 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:49:20.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-13T05:49:20.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-13T05:49:20.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705667' 2026-02-13T05:49:20.945 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:49:20.945 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:49:21.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-13T05:49:21.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-13T05:49:21.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705667 2-55834574852' 2026-02-13T05:49:21.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:49:21.008 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-13T05:49:21.008 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:49:21.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:49:21.009 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836484 2026-02-13T05:49:21.009 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:49:21.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836484 2026-02-13T05:49:21.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-13T05:49:21.011 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 21474836484 2026-02-13T05:49:21.011 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:49:21.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-13T05:49:21.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:49:22.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:49:22.233 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:49:22.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-13T05:49:22.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:49:22.453 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-13T05:49:22.454 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:49:22.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:49:22.455 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705667 2026-02-13T05:49:22.455 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:49:22.456 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705667 2026-02-13T05:49:22.456 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-13T05:49:22.457 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 38654705667 2026-02-13T05:49:22.457 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:49:22.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705668 -lt 38654705667 2026-02-13T05:49:22.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:49:22.679 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574852 2026-02-13T05:49:22.679 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:49:22.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:49:22.680 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574852 2026-02-13T05:49:22.680 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:49:22.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574852 2026-02-13T05:49:22.682 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 55834574852 2026-02-13T05:49:22.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574852' 2026-02-13T05:49:22.682 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:49:22.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-13T05:49:22.903 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:49:22.903 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:49:22.903 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:49:23.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-13T05:49:23.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:49:23.214 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:49:23.214 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:49:23.214 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:49:23.214 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:49:23.214 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:49:23.214 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:49:23.431 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-13T05:49:23.432 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:49:23.432 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:49:23.433 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:49:23.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-13T05:49:23.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:49:23.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:49:23.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:103: TEST_ec_profile_warning: for plugin in ${legacy_jerasure_plugins[*]} 2026-02-13T05:49:23.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:104: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-jerasure_generic crush-failure-domain=osd technique=reed_sol_van plugin=jerasure_generic 2026-02-13T05:49:24.028 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-13T05:49:24.028 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:24.028 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:24.028 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:24.028 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:24.028 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:24.028 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:24.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-13T05:49:24.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:24.069 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:24.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:106: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-jerasure_generic uses plugin jerasure_generic' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:24.075 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:23.902+0000 7f11a30fe640 0 mon.a@0(leader).osd e21 WARNING: erasure coding profile prof-jerasure_generic uses plugin jerasure_generic that has been deprecated. Please use jerasure instead. 2026-02-13T05:49:24.075 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:24.017+0000 7f11a30fe640 0 mon.a@0(leader).osd e22 WARNING: erasure coding profile prof-jerasure_generic uses plugin jerasure_generic that has been deprecated. Please use jerasure instead. 2026-02-13T05:49:24.075 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:24.017+0000 7f11a30fe640 0 mon.a@0(leader).osd e22 WARNING: erasure coding profile prof-jerasure_generic uses plugin jerasure_generic that has been deprecated. Please use jerasure instead. 2026-02-13T05:49:24.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:103: TEST_ec_profile_warning: for plugin in ${legacy_jerasure_plugins[*]} 2026-02-13T05:49:24.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:104: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-jerasure_sse3 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure_sse3 2026-02-13T05:49:24.364 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-13T05:49:24.364 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:24.365 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:24.365 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:24.365 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:24.365 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:24.365 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:24.365 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-13T05:49:24.365 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:24.405 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:24.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:106: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-jerasure_sse3 uses plugin jerasure_sse3' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:24.413 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:24.236+0000 7f11a30fe640 0 mon.a@0(leader).osd e22 WARNING: erasure coding profile prof-jerasure_sse3 uses plugin jerasure_sse3 that has been deprecated. Please use jerasure instead. 2026-02-13T05:49:24.413 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:24.353+0000 7f11a30fe640 0 mon.a@0(leader).osd e23 WARNING: erasure coding profile prof-jerasure_sse3 uses plugin jerasure_sse3 that has been deprecated. Please use jerasure instead. 2026-02-13T05:49:24.413 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:24.353+0000 7f11a30fe640 0 mon.a@0(leader).osd e23 WARNING: erasure coding profile prof-jerasure_sse3 uses plugin jerasure_sse3 that has been deprecated. Please use jerasure instead. 2026-02-13T05:49:24.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:103: TEST_ec_profile_warning: for plugin in ${legacy_jerasure_plugins[*]} 2026-02-13T05:49:24.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:104: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-jerasure_sse4 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure_sse4 2026-02-13T05:49:24.703 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-13T05:49:24.703 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:24.703 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:24.703 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:24.703 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:24.704 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:24.704 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:24.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-13T05:49:24.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:24.742 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:24.746 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:106: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-jerasure_sse4 uses plugin jerasure_sse4' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:24.748 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:24.574+0000 7f11a30fe640 0 mon.a@0(leader).osd e23 WARNING: erasure coding profile prof-jerasure_sse4 uses plugin jerasure_sse4 that has been deprecated. Please use jerasure instead. 2026-02-13T05:49:24.748 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:24.693+0000 7f11a30fe640 0 mon.a@0(leader).osd e24 WARNING: erasure coding profile prof-jerasure_sse4 uses plugin jerasure_sse4 that has been deprecated. Please use jerasure instead. 2026-02-13T05:49:24.748 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:24.693+0000 7f11a30fe640 0 mon.a@0(leader).osd e24 WARNING: erasure coding profile prof-jerasure_sse4 uses plugin jerasure_sse4 that has been deprecated. Please use jerasure instead. 2026-02-13T05:49:24.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:109: TEST_ec_profile_warning: for plugin in ${legacy_shec_plugins[*]} 2026-02-13T05:49:24.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:110: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-shec_generic crush-failure-domain=osd plugin=shec_generic 2026-02-13T05:49:25.029 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-13T05:49:25.030 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:25.030 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:25.030 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:25.030 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:25.030 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:25.030 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:25.030 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-13T05:49:25.030 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:25.068 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:25.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:112: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-shec_generic uses plugin shec_generic' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:25.074 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:24.903+0000 7f11a30fe640 0 mon.a@0(leader).osd e24 WARNING: erasure coding profile prof-shec_generic uses plugin shec_generic that has been deprecated. Please use shec instead. 2026-02-13T05:49:25.074 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:25.019+0000 7f11a30fe640 0 mon.a@0(leader).osd e25 WARNING: erasure coding profile prof-shec_generic uses plugin shec_generic that has been deprecated. Please use shec instead. 2026-02-13T05:49:25.074 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:25.019+0000 7f11a30fe640 0 mon.a@0(leader).osd e25 WARNING: erasure coding profile prof-shec_generic uses plugin shec_generic that has been deprecated. Please use shec instead. 2026-02-13T05:49:25.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:109: TEST_ec_profile_warning: for plugin in ${legacy_shec_plugins[*]} 2026-02-13T05:49:25.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:110: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-shec_sse3 crush-failure-domain=osd plugin=shec_sse3 2026-02-13T05:49:25.355 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-13T05:49:25.355 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:25.355 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:25.355 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:25.356 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:25.356 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:25.356 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:25.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-13T05:49:25.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:25.395 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:25.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:112: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-shec_sse3 uses plugin shec_sse3' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:25.400 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:25.230+0000 7f11a30fe640 0 mon.a@0(leader).osd e25 WARNING: erasure coding profile prof-shec_sse3 uses plugin shec_sse3 that has been deprecated. Please use shec instead. 2026-02-13T05:49:25.400 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:25.345+0000 7f11a30fe640 0 mon.a@0(leader).osd e26 WARNING: erasure coding profile prof-shec_sse3 uses plugin shec_sse3 that has been deprecated. Please use shec instead. 2026-02-13T05:49:25.401 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:25.345+0000 7f11a30fe640 0 mon.a@0(leader).osd e26 WARNING: erasure coding profile prof-shec_sse3 uses plugin shec_sse3 that has been deprecated. Please use shec instead. 2026-02-13T05:49:25.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:109: TEST_ec_profile_warning: for plugin in ${legacy_shec_plugins[*]} 2026-02-13T05:49:25.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:110: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-shec_sse4 crush-failure-domain=osd plugin=shec_sse4 2026-02-13T05:49:25.688 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-13T05:49:25.688 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:25.688 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:25.688 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:25.689 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:25.689 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:25.689 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:25.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-13T05:49:25.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:25.727 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:25.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:112: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-shec_sse4 uses plugin shec_sse4' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:25.733 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:25.562+0000 7f11a30fe640 0 mon.a@0(leader).osd e26 WARNING: erasure coding profile prof-shec_sse4 uses plugin shec_sse4 that has been deprecated. Please use shec instead. 2026-02-13T05:49:25.733 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:25.678+0000 7f11a30fe640 0 mon.a@0(leader).osd e27 WARNING: erasure coding profile prof-shec_sse4 uses plugin shec_sse4 that has been deprecated. Please use shec instead. 2026-02-13T05:49:25.733 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:25.678+0000 7f11a30fe640 0 mon.a@0(leader).osd e27 WARNING: erasure coding profile prof-shec_sse4 uses plugin shec_sse4 that has been deprecated. Please use shec instead. 2026-02-13T05:49:25.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:115: TEST_ec_profile_warning: teardown td/test-erasure-code-plugins 2026-02-13T05:49:25.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:25.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:25.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:25.735 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:25.735 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:25.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:25.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:25.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:25.841 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:25.841 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:25.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:25.842 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:25.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:25.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:25.844 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:25.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:25.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:25.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:25.846 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:25.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:25.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:25.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:25.854 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:25.854 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:25.854 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:25.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:25.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:25.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:25.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:35: run: for func in $funcs 2026-02-13T05:49:25.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:36: run: TEST_preload_no_warning td/test-erasure-code-plugins 2026-02-13T05:49:25.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:58: TEST_preload_no_warning: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:25.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:60: TEST_preload_no_warning: for plugin in ${plugins[*]} 2026-02-13T05:49:25.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:61: TEST_preload_no_warning: setup td/test-erasure-code-plugins 2026-02-13T05:49:25.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:25.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-13T05:49:25.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:25.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:25.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:25.857 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:25.857 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:25.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:25.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:25.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:25.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:25.859 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:25.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:25.859 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:25.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:25.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:25.860 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:25.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:25.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:25.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:25.861 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:25.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:25.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:25.863 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:25.864 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:25.864 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:25.864 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:25.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:25.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:25.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:25.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-13T05:49:25.866 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:25.866 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:25.866 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:25.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18932 2026-02-13T05:49:25.868 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:25.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:49:25.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:25.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-13T05:49:25.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:62: TEST_preload_no_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=jerasure 2026-02-13T05:49:25.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:25.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:25.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:25.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:25.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-13T05:49:25.869 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=jerasure 2026-02-13T05:49:25.888 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:25.888 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:25.888 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:25.888 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:25.888 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:25.888 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:25.889 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:25.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=jerasure 2026-02-13T05:49:25.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:25.913 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:25.914 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:25.914 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:25.914 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:25.914 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:25.915 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:25.915 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:25.915 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:25.915 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:25.915 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:25.916 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:25.916 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:25.916 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:25.916 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get fsid 2026-02-13T05:49:25.958 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:25.958 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:25.958 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:25.958 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:25.958 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:25.960 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:25.960 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:25.960 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:25.960 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:25.960 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:25.960 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:25.960 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:25.960 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:25.960 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:26.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:63: TEST_preload_no_warning: run_mgr td/test-erasure-code-plugins x 2026-02-13T05:49:26.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:26.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:26.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:26.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:26.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-13T05:49:26.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:26.099 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:26.099 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:26.099 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:26.099 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:26.099 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:26.099 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:26.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:26.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:26.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:26.118 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: get_asok_path mon.a 2026-02-13T05:49:26.118 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:26.118 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:26.118 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:26.118 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:26.118 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:26.118 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:26.118 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: CEPH_ARGS= 2026-02-13T05:49:26.118 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:26.158 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:26.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:65: TEST_preload_no_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=jerasure 2026-02-13T05:49:26.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-13T05:49:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-13T05:49:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-13T05:49:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:26.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:26.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:26.167 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:26.167 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:26.167 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:26.167 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:26.167 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:26.167 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:26.167 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:26.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:26.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:26.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=jerasure 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6dcb5a21-7641-4647-a53a-4e4152d884f4 2026-02-13T05:49:26.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 6dcb5a21-7641-4647-a53a-4e4152d884f4' 2026-02-13T05:49:26.169 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 6dcb5a21-7641-4647-a53a-4e4152d884f4 2026-02-13T05:49:26.169 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:26.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBmu45pLRiEChAAVgP25I62gDn1MzEFLvpZsA== 2026-02-13T05:49:26.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBmu45pLRiEChAAVgP25I62gDn1MzEFLvpZsA=="}' 2026-02-13T05:49:26.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6dcb5a21-7641-4647-a53a-4e4152d884f4 -i td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:26.281 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:26.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:26.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure --mkfs --key AQBmu45pLRiEChAAVgP25I62gDn1MzEFLvpZsA== --osd-uuid 6dcb5a21-7641-4647-a53a-4e4152d884f4 2026-02-13T05:49:26.305 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:26.304+0000 7f6eac8b4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:26.307 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:26.306+0000 7f6eac8b4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:26.308 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:26.306+0000 7f6eac8b4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:26.308 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:26.307+0000 7f6eac8b4900 -1 bdev(0x55d184d26c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:26.308 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:26.307+0000 7f6eac8b4900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-13T05:49:26.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-13T05:49:26.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:26.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:26.733 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:26.733 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:26.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:26.841 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:26.841 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure 2026-02-13T05:49:26.841 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:26.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:26.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:26.857 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:26.856+0000 7fcdb6453900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:26.858 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:26.857+0000 7fcdb6453900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:26.859 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:26.858+0000 7fcdb6453900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:26.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:26.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:26.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:26.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:26.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:26.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:26.938 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:26.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:26.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:26.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:27.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:27.063 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:27.061+0000 7fcdb6453900 -1 Falling back to public interface 2026-02-13T05:49:27.439 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:27.438+0000 7fcdb6453900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:28.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:28.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:28.036 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:28.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:28.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:28.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:28.135 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3642913631,v1:127.0.0.1:6801/3642913631] [v2:127.0.0.1:6802/3642913631,v1:127.0.0.1:6803/3642913631] exists,up 6dcb5a21-7641-4647-a53a-4e4152d884f4 2026-02-13T05:49:28.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:28.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:28.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:28.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: get_asok_path osd.0 2026-02-13T05:49:28.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:49:28.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:49:28.137 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:28.137 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:28.137 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:28.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-osd.0.asok 2026-02-13T05:49:28.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: CEPH_ARGS= 2026-02-13T05:49:28.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-osd.0.asok log flush 2026-02-13T05:49:28.184 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:28.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:67: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:28.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:68: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/osd.0.log 2026-02-13T05:49:28.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:69: TEST_preload_no_warning: teardown td/test-erasure-code-plugins 2026-02-13T05:49:28.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:28.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:28.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:28.193 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:28.193 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:28.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:28.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:28.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:28.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:28.299 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:28.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:28.300 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:28.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:28.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:28.302 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:28.302 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:28.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:28.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:28.303 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:28.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:28.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:28.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:28.308 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:28.308 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:28.308 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:28.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:28.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:28.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:28.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:60: TEST_preload_no_warning: for plugin in ${plugins[*]} 2026-02-13T05:49:28.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:61: TEST_preload_no_warning: setup td/test-erasure-code-plugins 2026-02-13T05:49:28.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:28.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-13T05:49:28.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:28.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:28.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:28.311 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:28.311 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:28.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:28.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:28.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:28.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:28.312 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:28.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:28.312 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:28.313 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:28.313 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:28.313 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:28.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:28.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:28.315 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:28.315 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:28.315 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:28.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:28.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:28.317 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:28.317 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:28.317 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:28.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:28.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:28.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:28.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-13T05:49:28.319 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:28.320 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:28.320 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:28.320 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18932 2026-02-13T05:49:28.320 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:28.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:49:28.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:28.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-13T05:49:28.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:62: TEST_preload_no_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=shec 2026-02-13T05:49:28.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:28.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:28.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:28.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:28.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-13T05:49:28.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=shec 2026-02-13T05:49:28.342 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:28.343 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:28.343 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:28.343 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:28.343 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:28.343 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:28.343 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:28.343 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=shec 2026-02-13T05:49:28.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:28.370 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:28.370 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:28.370 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:28.370 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:28.370 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:28.370 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:28.370 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:28.371 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:28.371 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:28.372 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:28.372 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:28.372 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:28.372 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:28.372 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get fsid 2026-02-13T05:49:28.416 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:28.416 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:28.416 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:28.417 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:28.417 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:28.418 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:28.418 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:28.418 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:28.418 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:28.418 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:28.418 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:28.418 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:28.418 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:28.419 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:28.463 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:63: TEST_preload_no_warning: run_mgr td/test-erasure-code-plugins x 2026-02-13T05:49:28.463 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:28.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:28.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:28.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:28.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-13T05:49:28.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:28.564 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:28.564 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:28.564 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:28.565 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:28.565 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:28.565 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:28.565 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:28.565 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:28.566 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:28.582 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: get_asok_path mon.a 2026-02-13T05:49:28.582 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:28.582 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:28.583 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:28.583 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:28.583 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:28.583 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:28.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: CEPH_ARGS= 2026-02-13T05:49:28.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:28.623 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:28.630 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:65: TEST_preload_no_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=shec 2026-02-13T05:49:28.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:28.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:28.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:28.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:28.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-13T05:49:28.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:28.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:28.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:28.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:28.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-13T05:49:28.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-13T05:49:28.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:28.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:28.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:28.632 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:28.632 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:28.632 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:28.632 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:28.632 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:28.632 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:28.632 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:28.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:28.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:28.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:28.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:28.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:28.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:28.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:28.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:28.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:28.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:28.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:28.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=shec 2026-02-13T05:49:28.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-13T05:49:28.633 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:28.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f3f22987-4c21-4ccc-9947-f3d6d9b0f49a 2026-02-13T05:49:28.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 f3f22987-4c21-4ccc-9947-f3d6d9b0f49a' 2026-02-13T05:49:28.635 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 f3f22987-4c21-4ccc-9947-f3d6d9b0f49a 2026-02-13T05:49:28.635 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:28.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBou45p3MNGJhAAmrkWyc98ZgIR9EI2jsCxnQ== 2026-02-13T05:49:28.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBou45p3MNGJhAAmrkWyc98ZgIR9EI2jsCxnQ=="}' 2026-02-13T05:49:28.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f3f22987-4c21-4ccc-9947-f3d6d9b0f49a -i td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:28.748 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:28.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:28.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec --mkfs --key AQBou45p3MNGJhAAmrkWyc98ZgIR9EI2jsCxnQ== --osd-uuid f3f22987-4c21-4ccc-9947-f3d6d9b0f49a 2026-02-13T05:49:28.772 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:28.771+0000 7f7ebaf4d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:28.774 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:28.773+0000 7f7ebaf4d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:28.775 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:28.774+0000 7f7ebaf4d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:28.775 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:28.774+0000 7f7ebaf4d900 -1 bdev(0x55a8c4198c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:28.775 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:28.774+0000 7f7ebaf4d900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-13T05:49:29.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-13T05:49:29.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:29.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:29.206 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:29.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:29.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:29.309 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:29.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec 2026-02-13T05:49:29.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:29.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:29.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:29.325 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:29.324+0000 7f4070ad9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:29.326 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:29.325+0000 7f4070ad9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:29.327 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:29.326+0000 7f4070ad9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:29.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:29.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:29.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:29.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:29.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:29.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:29.408 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:29.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:29.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:29.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:29.505 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:29.513 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:29.512+0000 7f4070ad9900 -1 Falling back to public interface 2026-02-13T05:49:29.857 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:29.856+0000 7f4070ad9900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:30.506 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:30.506 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:30.507 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:30.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:30.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:30.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:30.603 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3523846140,v1:127.0.0.1:6801/3523846140] [v2:127.0.0.1:6802/3523846140,v1:127.0.0.1:6803/3523846140] exists,up f3f22987-4c21-4ccc-9947-f3d6d9b0f49a 2026-02-13T05:49:30.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:30.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:30.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:30.605 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: get_asok_path osd.0 2026-02-13T05:49:30.605 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:49:30.605 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:49:30.605 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:30.605 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:30.605 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:30.605 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-osd.0.asok 2026-02-13T05:49:30.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: CEPH_ARGS= 2026-02-13T05:49:30.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-osd.0.asok log flush 2026-02-13T05:49:30.652 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:30.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:67: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:30.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:68: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/osd.0.log 2026-02-13T05:49:30.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:69: TEST_preload_no_warning: teardown td/test-erasure-code-plugins 2026-02-13T05:49:30.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:30.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:30.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:30.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:30.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:30.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:30.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:30.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:30.766 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:30.766 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:30.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:30.768 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:30.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:30.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:30.769 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:30.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:30.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:30.771 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:30.771 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:30.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:30.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:30.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:30.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:30.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:30.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:30.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:30.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:30.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:30.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:60: TEST_preload_no_warning: for plugin in ${plugins[*]} 2026-02-13T05:49:30.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:61: TEST_preload_no_warning: setup td/test-erasure-code-plugins 2026-02-13T05:49:30.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:30.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-13T05:49:30.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:30.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:30.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:30.779 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:30.779 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:30.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:30.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:30.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:30.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:30.780 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:30.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:30.780 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:30.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:30.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:30.782 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:30.782 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:30.782 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:30.783 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:30.783 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:30.783 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:30.784 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:30.784 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:30.786 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:30.786 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:30.786 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:30.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:30.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:30.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:30.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-13T05:49:30.788 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:30.788 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:30.788 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:30.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18932 2026-02-13T05:49:30.789 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:30.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:49:30.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:30.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-13T05:49:30.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:62: TEST_preload_no_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=lrc 2026-02-13T05:49:30.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:30.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:30.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:30.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:30.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-13T05:49:30.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=lrc 2026-02-13T05:49:30.809 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:30.809 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:30.810 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:30.810 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:30.811 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:30.811 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:30.811 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:30.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=lrc 2026-02-13T05:49:30.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:30.838 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:30.838 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:30.838 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:30.838 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:30.838 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:30.838 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:30.838 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:30.838 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:30.839 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:30.839 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:30.839 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:30.839 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:30.839 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:30.840 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get fsid 2026-02-13T05:49:30.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:30.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:30.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:30.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:30.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:30.885 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:30.886 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:30.886 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:30.886 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:30.886 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:30.886 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:30.886 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:30.886 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:30.886 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:30.928 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:63: TEST_preload_no_warning: run_mgr td/test-erasure-code-plugins x 2026-02-13T05:49:30.929 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:30.929 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:30.929 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:30.929 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:30.929 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-13T05:49:30.929 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:31.030 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:31.031 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:31.031 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:31.031 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:31.031 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:31.031 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:31.031 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:31.031 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:31.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:31.049 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: get_asok_path mon.a 2026-02-13T05:49:31.049 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:31.050 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:31.050 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:31.050 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:31.050 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:31.050 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:31.050 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: CEPH_ARGS= 2026-02-13T05:49:31.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:31.091 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:31.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:65: TEST_preload_no_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=lrc 2026-02-13T05:49:31.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:31.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:31.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:31.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:31.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-13T05:49:31.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:31.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:31.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:31.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:31.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-13T05:49:31.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-13T05:49:31.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:31.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:31.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:31.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:31.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:31.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:31.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:31.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:31.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:31.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=lrc 2026-02-13T05:49:31.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-13T05:49:31.101 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:31.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=34a522a7-d84a-41f8-80e5-243b34555e82 2026-02-13T05:49:31.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 34a522a7-d84a-41f8-80e5-243b34555e82' 2026-02-13T05:49:31.102 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 34a522a7-d84a-41f8-80e5-243b34555e82 2026-02-13T05:49:31.102 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:31.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBru45pIPeMBhAAmNNGUDEAGmX+kCD5ySbg1w== 2026-02-13T05:49:31.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBru45pIPeMBhAAmNNGUDEAGmX+kCD5ySbg1w=="}' 2026-02-13T05:49:31.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 34a522a7-d84a-41f8-80e5-243b34555e82 -i td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:31.212 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:31.219 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:31.219 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=lrc --mkfs --key AQBru45pIPeMBhAAmNNGUDEAGmX+kCD5ySbg1w== --osd-uuid 34a522a7-d84a-41f8-80e5-243b34555e82 2026-02-13T05:49:31.237 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:31.236+0000 7fcf00f2d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:31.238 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:31.237+0000 7fcf00f2d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:31.239 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:31.238+0000 7fcf00f2d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:31.240 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:31.238+0000 7fcf00f2d900 -1 bdev(0x562bd9de4c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:31.240 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:31.238+0000 7fcf00f2d900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-13T05:49:31.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-13T05:49:31.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:31.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:31.647 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:31.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:31.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:31.748 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:31.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=lrc 2026-02-13T05:49:31.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:31.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:31.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:31.764 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:31.763+0000 7f6188d5f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:31.766 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:31.765+0000 7f6188d5f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:31.767 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:31.765+0000 7f6188d5f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:31.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:31.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:31.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:31.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:31.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:31.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:31.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:31.847 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:31.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:31.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:31.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:31.967 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:31.966+0000 7f6188d5f900 -1 Falling back to public interface 2026-02-13T05:49:32.348 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:32.347+0000 7f6188d5f900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:32.945 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:32.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:32.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:32.946 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:32.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:32.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:33.042 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2203227994,v1:127.0.0.1:6801/2203227994] [v2:127.0.0.1:6802/2203227994,v1:127.0.0.1:6803/2203227994] exists,up 34a522a7-d84a-41f8-80e5-243b34555e82 2026-02-13T05:49:33.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:33.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:33.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:33.044 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: get_asok_path osd.0 2026-02-13T05:49:33.044 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:49:33.044 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:49:33.044 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:33.045 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:33.045 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:33.045 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-osd.0.asok 2026-02-13T05:49:33.045 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: CEPH_ARGS= 2026-02-13T05:49:33.045 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-osd.0.asok log flush 2026-02-13T05:49:33.093 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:33.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:67: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:33.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:68: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/osd.0.log 2026-02-13T05:49:33.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:69: TEST_preload_no_warning: teardown td/test-erasure-code-plugins 2026-02-13T05:49:33.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:33.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:33.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:33.102 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:33.102 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:33.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:33.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:33.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:33.208 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:33.209 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:33.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:33.210 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:33.211 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:33.211 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:33.211 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:33.212 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:33.212 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:33.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:33.213 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:33.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:33.215 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:33.215 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:33.217 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:33.217 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:33.217 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:33.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:33.219 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:33.219 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:33.219 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:60: TEST_preload_no_warning: for plugin in ${plugins[*]} 2026-02-13T05:49:33.220 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:61: TEST_preload_no_warning: setup td/test-erasure-code-plugins 2026-02-13T05:49:33.220 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:33.220 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-13T05:49:33.220 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:33.220 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:33.220 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:33.220 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:33.220 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:33.220 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:33.220 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:33.220 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:33.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:33.221 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:33.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:33.222 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:33.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:33.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:33.223 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:33.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:33.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:33.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:33.224 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:33.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:33.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:33.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:33.227 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:33.227 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:33.227 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:33.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:33.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:33.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:33.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-13T05:49:33.229 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:33.229 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:33.229 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:33.229 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18932 2026-02-13T05:49:33.230 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:33.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:49:33.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:33.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-13T05:49:33.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:62: TEST_preload_no_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=isa 2026-02-13T05:49:33.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:33.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:33.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:33.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:33.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-13T05:49:33.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=isa 2026-02-13T05:49:33.250 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:33.250 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:33.250 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:33.250 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:33.250 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:33.250 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:33.250 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:33.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=isa 2026-02-13T05:49:33.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:33.275 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:33.275 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:33.275 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:33.275 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:33.276 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:33.277 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:33.277 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:33.277 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:33.277 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:33.277 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:33.277 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:33.277 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:33.277 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:33.277 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get fsid 2026-02-13T05:49:33.322 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:33.322 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:33.322 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:33.322 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:33.322 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:33.323 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:33.324 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:33.324 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:33.324 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:33.324 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:33.324 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:33.324 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:33.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:33.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:33.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:63: TEST_preload_no_warning: run_mgr td/test-erasure-code-plugins x 2026-02-13T05:49:33.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:33.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:33.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:33.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:33.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-13T05:49:33.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:33.468 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:33.468 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:33.468 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:33.468 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:33.468 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:33.468 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:33.468 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:33.469 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:33.469 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:33.486 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: get_asok_path mon.a 2026-02-13T05:49:33.486 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:33.486 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:33.486 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:33.486 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:33.486 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:33.486 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:33.487 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: CEPH_ARGS= 2026-02-13T05:49:33.487 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:33.527 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:33.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:65: TEST_preload_no_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=isa 2026-02-13T05:49:33.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:33.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:33.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:33.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:33.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-13T05:49:33.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:33.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:33.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:33.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:33.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-13T05:49:33.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-13T05:49:33.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:33.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:33.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:33.535 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:33.535 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:33.536 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:33.536 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:33.536 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:33.536 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:33.536 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:33.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:33.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:33.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:33.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:33.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:33.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:33.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:33.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:33.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:33.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:33.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:33.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=isa 2026-02-13T05:49:33.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-13T05:49:33.537 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:33.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=db716d31-cb76-4413-bc45-e5631bf91011 2026-02-13T05:49:33.538 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 db716d31-cb76-4413-bc45-e5631bf91011 2026-02-13T05:49:33.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 db716d31-cb76-4413-bc45-e5631bf91011' 2026-02-13T05:49:33.538 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:33.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBtu45pGcyRIBAAs9FHxVXZr7Zs7Bzhxdsrig== 2026-02-13T05:49:33.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBtu45pGcyRIBAAs9FHxVXZr7Zs7Bzhxdsrig=="}' 2026-02-13T05:49:33.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new db716d31-cb76-4413-bc45-e5631bf91011 -i td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:33.649 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:33.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:33.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=isa --mkfs --key AQBtu45pGcyRIBAAs9FHxVXZr7Zs7Bzhxdsrig== --osd-uuid db716d31-cb76-4413-bc45-e5631bf91011 2026-02-13T05:49:33.673 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:33.672+0000 7ff33fd24900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:33.675 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:33.674+0000 7ff33fd24900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:33.676 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:33.675+0000 7ff33fd24900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:33.676 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:33.675+0000 7ff33fd24900 -1 bdev(0x556bef992c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:33.676 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:33.675+0000 7ff33fd24900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-13T05:49:34.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-13T05:49:34.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:34.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:34.081 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:34.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:34.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:34.184 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:34.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=isa 2026-02-13T05:49:34.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:34.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:34.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:34.200 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:34.199+0000 7fe1a4e97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:34.201 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:34.200+0000 7fe1a4e97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:34.202 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:34.201+0000 7fe1a4e97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:34.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:34.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:34.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:34.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:34.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:34.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:34.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:34.282 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:34.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:34.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:34.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:34.410 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:34.409+0000 7fe1a4e97900 -1 Falling back to public interface 2026-02-13T05:49:34.773 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:34.772+0000 7fe1a4e97900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:35.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:35.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:35.379 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:35.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:35.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:35.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:35.475 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/389792066,v1:127.0.0.1:6801/389792066] [v2:127.0.0.1:6802/389792066,v1:127.0.0.1:6803/389792066] exists,up db716d31-cb76-4413-bc45-e5631bf91011 2026-02-13T05:49:35.476 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:35.476 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:35.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:35.477 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: get_asok_path osd.0 2026-02-13T05:49:35.477 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:49:35.477 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:49:35.477 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:35.477 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:35.477 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:35.477 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-osd.0.asok 2026-02-13T05:49:35.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: CEPH_ARGS= 2026-02-13T05:49:35.478 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-osd.0.asok log flush 2026-02-13T05:49:35.524 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:35.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:67: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:35.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:68: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/osd.0.log 2026-02-13T05:49:35.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:69: TEST_preload_no_warning: teardown td/test-erasure-code-plugins 2026-02-13T05:49:35.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:35.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:35.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:35.532 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:35.532 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:35.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:35.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:35.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:35.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:35.639 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:35.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:35.640 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:35.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:35.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:35.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:35.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:35.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:35.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:35.643 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:35.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:35.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:35.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:35.648 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:35.648 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:35.648 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:35.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:35.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:35.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:35.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:72: TEST_preload_no_warning: return 0 2026-02-13T05:49:35.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:35: run: for func in $funcs 2026-02-13T05:49:35.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:36: run: TEST_preload_no_warning_default td/test-erasure-code-plugins 2026-02-13T05:49:35.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:76: TEST_preload_no_warning_default: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:35.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:78: TEST_preload_no_warning_default: setup td/test-erasure-code-plugins 2026-02-13T05:49:35.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:35.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-13T05:49:35.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:35.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:35.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:35.651 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:35.651 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:35.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:35.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:35.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:35.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:35.653 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:35.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:35.653 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:35.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:35.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:35.654 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:35.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:35.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:35.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:35.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:35.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:35.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:35.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:35.657 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:35.657 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:35.658 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:35.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:35.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:35.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:35.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-13T05:49:35.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:35.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:35.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:35.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18932 2026-02-13T05:49:35.661 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:35.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:49:35.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:35.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-13T05:49:35.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:79: TEST_preload_no_warning_default: run_mon td/test-erasure-code-plugins a 2026-02-13T05:49:35.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:35.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:35.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:35.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:35.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-13T05:49:35.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins 2026-02-13T05:49:35.681 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:35.681 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:35.681 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:35.681 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:35.681 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:35.681 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:35.681 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:35.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:49:35.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:35.707 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:35.707 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:35.707 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:35.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:35.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:35.709 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:35.709 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:35.709 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:35.709 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:35.709 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:35.709 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:35.710 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:35.710 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:35.710 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get fsid 2026-02-13T05:49:35.756 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:35.756 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:35.756 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:35.756 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:35.756 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:35.757 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:35.757 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:35.757 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:35.757 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:35.758 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:35.758 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:35.758 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:35.758 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:35.758 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:35.801 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:80: TEST_preload_no_warning_default: get_asok_path mon.a 2026-02-13T05:49:35.801 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:35.801 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:35.801 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:35.801 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:35.801 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:35.801 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:35.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:80: TEST_preload_no_warning_default: CEPH_ARGS= 2026-02-13T05:49:35.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:80: TEST_preload_no_warning_default: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:35.839 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:35.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:81: TEST_preload_no_warning_default: run_mgr td/test-erasure-code-plugins x 2026-02-13T05:49:35.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:35.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:35.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:35.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:35.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-13T05:49:35.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:35.942 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:35.943 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:35.943 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:35.943 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:35.943 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:35.943 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:35.943 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:35.944 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:35.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:35.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:82: TEST_preload_no_warning_default: run_osd td/test-erasure-code-plugins 0 2026-02-13T05:49:35.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:35.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:35.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:35.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:35.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-13T05:49:35.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:35.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:35.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:35.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:35.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-13T05:49:35.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-13T05:49:35.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:35.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:35.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:35.964 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:35.964 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:35.964 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:35.964 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:35.964 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:35.964 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:35.964 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:35.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:35.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:35.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:35.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:35.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:35.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:35.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:35.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:35.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:35.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:35.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:35.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:49:35.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-13T05:49:35.965 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:35.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d5dfe06b-2e42-4462-9871-46095a60dc4d 2026-02-13T05:49:35.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d5dfe06b-2e42-4462-9871-46095a60dc4d' 2026-02-13T05:49:35.966 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 d5dfe06b-2e42-4462-9871-46095a60dc4d 2026-02-13T05:49:35.967 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:35.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBvu45phi4DOhAA8IfFIrZ2lkKK7Obe0XDbKQ== 2026-02-13T05:49:35.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBvu45phi4DOhAA8IfFIrZ2lkKK7Obe0XDbKQ=="}' 2026-02-13T05:49:35.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d5dfe06b-2e42-4462-9871-46095a60dc4d -i td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:36.077 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:36.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:36.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBvu45phi4DOhAA8IfFIrZ2lkKK7Obe0XDbKQ== --osd-uuid d5dfe06b-2e42-4462-9871-46095a60dc4d 2026-02-13T05:49:36.102 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:36.101+0000 7fdcef746900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:36.104 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:36.102+0000 7fdcef746900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:36.105 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:36.103+0000 7fdcef746900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:36.105 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:36.104+0000 7fdcef746900 -1 bdev(0x55df119e8c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:36.105 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:36.104+0000 7fdcef746900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-13T05:49:36.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-13T05:49:36.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:36.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:36.533 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:36.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:36.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:36.638 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:36.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:49:36.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:36.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:36.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:36.655 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:36.654+0000 7f61dd622900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:36.657 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:36.656+0000 7f61dd622900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:36.658 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:36.657+0000 7f61dd622900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:36.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:36.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:36.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:36.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:36.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:36.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:36.736 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:36.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:36.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:36.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:36.833 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:36.856 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:36.855+0000 7f61dd622900 -1 Falling back to public interface 2026-02-13T05:49:37.246 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:37.244+0000 7f61dd622900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:37.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:37.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:37.835 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:37.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:37.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:37.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:37.932 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1929170007,v1:127.0.0.1:6801/1929170007] [v2:127.0.0.1:6802/1929170007,v1:127.0.0.1:6803/1929170007] exists,up d5dfe06b-2e42-4462-9871-46095a60dc4d 2026-02-13T05:49:37.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:37.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:37.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:37.934 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:83: TEST_preload_no_warning_default: get_asok_path osd.0 2026-02-13T05:49:37.934 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:49:37.934 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:49:37.934 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:37.935 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:37.935 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:37.935 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-osd.0.asok 2026-02-13T05:49:37.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:83: TEST_preload_no_warning_default: CEPH_ARGS= 2026-02-13T05:49:37.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:83: TEST_preload_no_warning_default: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-osd.0.asok log flush 2026-02-13T05:49:37.981 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:37.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:84: TEST_preload_no_warning_default: grep 'WARNING: osd_erasure_code_plugins' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:37.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:85: TEST_preload_no_warning_default: grep 'WARNING: osd_erasure_code_plugins' td/test-erasure-code-plugins/osd.0.log 2026-02-13T05:49:37.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:86: TEST_preload_no_warning_default: teardown td/test-erasure-code-plugins 2026-02-13T05:49:37.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:37.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:37.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:37.989 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:37.989 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:37.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:37.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:37.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:38.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:38.096 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:38.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:38.097 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:38.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:38.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:38.099 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:38.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:38.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:38.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:38.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:38.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:38.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:38.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:38.105 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:38.105 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:38.105 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:38.105 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:38.107 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:38.107 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:38.107 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:88: TEST_preload_no_warning_default: return 0 2026-02-13T05:49:38.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:35: run: for func in $funcs 2026-02-13T05:49:38.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:36: run: TEST_preload_warning td/test-erasure-code-plugins 2026-02-13T05:49:38.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:41: TEST_preload_warning: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:38.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-13T05:49:38.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-13T05:49:38.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:38.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-13T05:49:38.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:38.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:38.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:38.109 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:38.109 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:38.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:38.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:38.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:38.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:38.110 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:38.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:38.111 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:38.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:38.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:38.111 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:38.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:38.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:38.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:38.112 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:38.113 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:38.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:38.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:38.115 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:38.115 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:38.115 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:38.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:38.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:38.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:38.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-13T05:49:38.117 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:38.117 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:38.117 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:38.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18932 2026-02-13T05:49:38.118 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:38.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:49:38.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:38.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-13T05:49:38.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=jerasure_generic 2026-02-13T05:49:38.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:38.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:38.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:38.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:38.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-13T05:49:38.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=jerasure_generic 2026-02-13T05:49:38.139 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:38.140 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:38.140 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:38.140 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:38.140 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:38.140 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:38.140 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:38.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=jerasure_generic 2026-02-13T05:49:38.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:38.165 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:38.166 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:38.166 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:38.166 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:38.166 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:38.167 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:38.167 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:38.167 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:38.167 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:38.167 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:38.167 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:38.168 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:38.168 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:38.168 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get fsid 2026-02-13T05:49:38.212 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:38.213 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:38.213 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:38.213 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:38.213 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:38.213 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:38.213 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:38.214 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:38.214 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:38.215 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:38.215 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:38.215 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:38.215 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:38.215 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:38.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-13T05:49:38.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:38.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:38.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:38.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:38.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-13T05:49:38.258 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:38.359 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:38.359 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:38.359 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:38.359 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:38.359 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:38.360 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:38.360 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:38.360 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:38.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:38.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-13T05:49:38.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:38.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:38.378 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:38.378 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:38.378 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:38.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:38.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-13T05:49:38.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:38.419 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:38.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=jerasure_generic 2026-02-13T05:49:38.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:38.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:38.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:38.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:38.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-13T05:49:38.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:38.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:38.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:38.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:38.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-13T05:49:38.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-13T05:49:38.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:38.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:38.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:38.427 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:38.427 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:38.427 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:38.427 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:38.427 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:38.427 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:38.427 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:38.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:38.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:38.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:38.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:38.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:38.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:38.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:38.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:38.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:38.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:38.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:38.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=jerasure_generic 2026-02-13T05:49:38.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-13T05:49:38.429 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:38.430 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=acf9bc77-b975-48e8-9bff-28569309101b 2026-02-13T05:49:38.430 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 acf9bc77-b975-48e8-9bff-28569309101b' 2026-02-13T05:49:38.430 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 acf9bc77-b975-48e8-9bff-28569309101b 2026-02-13T05:49:38.430 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:38.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQByu45pZVcOGhAAmfkItDyuy+COO5bxA5hx4A== 2026-02-13T05:49:38.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQByu45pZVcOGhAAmfkItDyuy+COO5bxA5hx4A=="}' 2026-02-13T05:49:38.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new acf9bc77-b975-48e8-9bff-28569309101b -i td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:38.543 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:38.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:38.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_generic --mkfs --key AQByu45pZVcOGhAAmfkItDyuy+COO5bxA5hx4A== --osd-uuid acf9bc77-b975-48e8-9bff-28569309101b 2026-02-13T05:49:38.567 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:38.566+0000 7f2a5d80c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:38.569 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:38.568+0000 7f2a5d80c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:38.569 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:38.568+0000 7f2a5d80c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:38.570 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:38.569+0000 7f2a5d80c900 -1 bdev(0x55adc0f92c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:38.570 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:38.569+0000 7f2a5d80c900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-13T05:49:38.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-13T05:49:38.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:38.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:38.983 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:38.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:39.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:39.085 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:39.086 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_generic 2026-02-13T05:49:39.086 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:39.086 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:39.086 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:39.102 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:39.101+0000 7fae0e419900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:39.104 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:39.103+0000 7fae0e419900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:39.105 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:39.104+0000 7fae0e419900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:39.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:39.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:39.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:39.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:39.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:39.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:39.185 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:39.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:39.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:39.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:39.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:39.319 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:39.318+0000 7fae0e419900 -1 Falling back to public interface 2026-02-13T05:49:39.712 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:39.711+0000 7fae0e419900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:40.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:40.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:40.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:40.283 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:40.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:40.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:40.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:41.381 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:41.381 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:41.381 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:49:41.382 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T05:49:41.382 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:41.382 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:41.602 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1495709474,v1:127.0.0.1:6801/1495709474] [v2:127.0.0.1:6802/1495709474,v1:127.0.0.1:6803/1495709474] exists,up acf9bc77-b975-48e8-9bff-28569309101b 2026-02-13T05:49:41.604 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:41.604 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:41.604 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:41.604 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-13T05:49:41.605 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:49:41.605 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:49:41.605 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:41.605 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:41.605 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:41.605 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-osd.0.asok 2026-02-13T05:49:41.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-13T05:49:41.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-osd.0.asok log flush 2026-02-13T05:49:41.650 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:41.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_generic' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:41.656 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:38.155+0000 7f2f13618d80 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_generic that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-13T05:49:41.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_generic' td/test-erasure-code-plugins/osd.0.log 2026-02-13T05:49:41.657 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:39.318+0000 7fae0e419900 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_generic that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-13T05:49:41.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-13T05:49:41.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:41.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:41.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:41.658 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:41.659 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:41.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:41.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:41.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:41.765 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:41.766 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:41.766 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:41.767 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:41.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:41.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:41.769 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:41.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:41.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:41.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:41.770 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:41.771 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:41.771 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:41.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:41.775 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:41.775 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:41.775 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:41.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:41.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:41.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:41.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-13T05:49:41.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-13T05:49:41.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:41.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-13T05:49:41.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:41.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:41.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:41.777 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:41.778 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:41.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:41.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:41.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:41.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:41.778 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:41.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:41.779 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:41.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:41.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:41.780 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:41.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:41.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:41.782 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:41.782 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:41.782 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:41.783 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:41.783 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:41.784 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:41.785 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:41.785 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:41.785 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:41.785 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:41.785 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:41.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-13T05:49:41.786 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:41.787 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:41.787 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:41.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18932 2026-02-13T05:49:41.788 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:49:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-13T05:49:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=jerasure_sse3 2026-02-13T05:49:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-13T05:49:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=jerasure_sse3 2026-02-13T05:49:41.808 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:41.808 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:41.808 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:41.809 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:41.809 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:41.809 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:41.809 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:41.809 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=jerasure_sse3 2026-02-13T05:49:41.834 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:41.835 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:41.835 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:41.835 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:41.835 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:41.836 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:41.836 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:41.836 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:41.836 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:41.837 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:41.837 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:41.837 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:41.837 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:41.837 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:41.837 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get fsid 2026-02-13T05:49:41.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:41.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:41.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:41.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:41.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:41.882 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:41.882 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:41.882 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:41.882 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:41.882 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:41.882 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:41.882 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:41.882 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:41.882 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:41.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-13T05:49:41.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:41.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:41.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:41.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:41.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-13T05:49:41.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:42.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:42.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:42.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:42.027 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:42.027 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:42.027 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:42.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:42.028 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:42.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:42.045 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-13T05:49:42.045 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:42.045 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:42.046 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:42.046 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:42.046 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:42.046 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:42.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-13T05:49:42.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:42.086 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:42.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=jerasure_sse3 2026-02-13T05:49:42.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:42.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:42.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:42.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:42.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-13T05:49:42.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:42.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:42.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:42.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:42.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-13T05:49:42.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-13T05:49:42.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:42.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:42.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:42.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:42.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:42.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:42.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:42.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:42.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:42.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=jerasure_sse3 2026-02-13T05:49:42.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-13T05:49:42.095 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:42.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c07ac946-9db7-473f-a14c-5d78aa7f0d43 2026-02-13T05:49:42.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c07ac946-9db7-473f-a14c-5d78aa7f0d43' 2026-02-13T05:49:42.096 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 c07ac946-9db7-473f-a14c-5d78aa7f0d43 2026-02-13T05:49:42.096 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:42.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB2u45pZn0oBhAAFIA8mTrwsV+e2pQX0zLFhQ== 2026-02-13T05:49:42.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB2u45pZn0oBhAAFIA8mTrwsV+e2pQX0zLFhQ=="}' 2026-02-13T05:49:42.104 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c07ac946-9db7-473f-a14c-5d78aa7f0d43 -i td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:42.206 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:42.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:42.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_sse3 --mkfs --key AQB2u45pZn0oBhAAFIA8mTrwsV+e2pQX0zLFhQ== --osd-uuid c07ac946-9db7-473f-a14c-5d78aa7f0d43 2026-02-13T05:49:42.231 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:42.231+0000 7f7054303900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:42.233 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:42.232+0000 7f7054303900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:42.234 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:42.233+0000 7f7054303900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:42.234 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:42.234+0000 7f7054303900 -1 bdev(0x55e19139ac00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:42.234 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:42.234+0000 7f7054303900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-13T05:49:42.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-13T05:49:42.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:42.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:42.711 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:42.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:42.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:42.814 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:42.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_sse3 2026-02-13T05:49:42.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:42.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:42.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:42.830 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:42.830+0000 7fd3e360d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:42.831 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:42.831+0000 7fd3e360d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:42.832 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:42.832+0000 7fd3e360d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:42.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:42.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:42.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:42.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:42.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:42.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:42.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:42.912 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:42.912 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:42.912 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:43.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:43.051 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:43.051+0000 7fd3e360d900 -1 Falling back to public interface 2026-02-13T05:49:43.408 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:43.408+0000 7fd3e360d900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:44.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:44.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:44.012 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:44.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:44.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:44.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:44.107 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/69670350,v1:127.0.0.1:6801/69670350] [v2:127.0.0.1:6802/69670350,v1:127.0.0.1:6803/69670350] exists,up c07ac946-9db7-473f-a14c-5d78aa7f0d43 2026-02-13T05:49:44.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:44.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:44.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:44.109 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-13T05:49:44.109 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:49:44.109 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:49:44.110 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:44.110 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:44.110 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:44.110 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-osd.0.asok 2026-02-13T05:49:44.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-13T05:49:44.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-osd.0.asok log flush 2026-02-13T05:49:44.154 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:44.159 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_sse3' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:44.160 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:41.826+0000 7fd9849d2d80 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_sse3 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-13T05:49:44.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_sse3' td/test-erasure-code-plugins/osd.0.log 2026-02-13T05:49:44.161 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:43.051+0000 7fd3e360d900 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_sse3 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-13T05:49:44.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-13T05:49:44.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:44.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:44.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:44.162 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:44.163 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:44.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:44.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:44.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:44.268 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:44.268 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:44.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:44.270 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:44.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:44.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:44.271 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:44.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:44.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:44.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:44.273 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:44.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:44.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:44.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:44.277 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:44.277 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:44.277 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:44.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:44.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:44.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:44.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-13T05:49:44.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-13T05:49:44.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:44.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-13T05:49:44.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:44.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:44.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:44.280 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:44.280 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:44.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:44.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:44.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:44.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:44.281 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:44.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:44.282 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:44.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:44.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:44.283 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:44.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:44.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:44.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:44.284 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:44.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:44.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:44.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:44.287 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:44.287 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:44.287 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:44.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:44.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:44.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:44.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-13T05:49:44.289 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:44.289 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:44.289 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:44.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18932 2026-02-13T05:49:44.290 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:44.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:49:44.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:44.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-13T05:49:44.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=jerasure_sse4 2026-02-13T05:49:44.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:44.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:44.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:44.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:44.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-13T05:49:44.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=jerasure_sse4 2026-02-13T05:49:44.311 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:44.311 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:44.311 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:44.311 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:44.311 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:44.311 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:44.311 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:44.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=jerasure_sse4 2026-02-13T05:49:44.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:44.337 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:44.338 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:44.338 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:44.338 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:44.338 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:44.339 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:44.339 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:44.339 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:44.339 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:44.339 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:44.340 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:44.340 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:44.340 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:44.340 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get fsid 2026-02-13T05:49:44.383 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:44.383 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:44.384 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:44.384 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:44.384 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:44.385 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:44.385 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:44.385 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:44.385 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:44.385 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:44.385 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:44.386 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:44.386 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:44.386 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:44.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-13T05:49:44.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:44.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:44.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:44.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:44.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-13T05:49:44.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:44.528 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:44.528 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:44.528 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:44.528 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:44.528 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:44.528 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:44.528 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:44.529 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:44.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:44.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-13T05:49:44.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:44.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:44.547 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:44.547 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:44.547 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:44.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:44.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-13T05:49:44.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:44.587 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:44.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=jerasure_sse4 2026-02-13T05:49:44.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:44.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:44.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:44.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:44.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-13T05:49:44.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:44.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:44.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:44.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:44.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:44.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:44.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:44.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:44.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:44.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:44.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:44.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:44.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:44.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:44.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:44.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=jerasure_sse4 2026-02-13T05:49:44.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-13T05:49:44.596 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:44.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=58d15eb7-27eb-42e0-a7c6-e91776486633 2026-02-13T05:49:44.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 58d15eb7-27eb-42e0-a7c6-e91776486633' 2026-02-13T05:49:44.597 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 58d15eb7-27eb-42e0-a7c6-e91776486633 2026-02-13T05:49:44.598 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:44.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB4u45pXtITJBAAzIo0LZsuPnh7eSduiJOOmg== 2026-02-13T05:49:44.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB4u45pXtITJBAAzIo0LZsuPnh7eSduiJOOmg=="}' 2026-02-13T05:49:44.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 58d15eb7-27eb-42e0-a7c6-e91776486633 -i td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:44.709 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:44.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:44.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_sse4 --mkfs --key AQB4u45pXtITJBAAzIo0LZsuPnh7eSduiJOOmg== --osd-uuid 58d15eb7-27eb-42e0-a7c6-e91776486633 2026-02-13T05:49:44.734 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:44.734+0000 7f1ef14b6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:44.735 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:44.735+0000 7f1ef14b6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:44.736 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:44.736+0000 7f1ef14b6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:44.737 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:44.736+0000 7f1ef14b6900 -1 bdev(0x55b006bd8c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:44.737 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:44.736+0000 7f1ef14b6900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-13T05:49:45.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-13T05:49:45.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:45.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:45.121 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:45.121 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:45.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:45.228 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:45.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_sse4 2026-02-13T05:49:45.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:45.229 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:45.229 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:45.243 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:45.243+0000 7f0fe7a0e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:45.245 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:45.245+0000 7f0fe7a0e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:45.246 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:45.246+0000 7f0fe7a0e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:45.325 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:45.325 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:45.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:45.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:45.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:45.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:45.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:45.326 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:45.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:45.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:45.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:45.435 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:45.435+0000 7f0fe7a0e900 -1 Falling back to public interface 2026-02-13T05:49:45.777 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:45.777+0000 7f0fe7a0e900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:46.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:46.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:46.425 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:46.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:46.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:46.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:46.521 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1543461245,v1:127.0.0.1:6801/1543461245] [v2:127.0.0.1:6802/1543461245,v1:127.0.0.1:6803/1543461245] exists,up 58d15eb7-27eb-42e0-a7c6-e91776486633 2026-02-13T05:49:46.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:46.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:46.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:46.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-13T05:49:46.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:49:46.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:49:46.523 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:46.524 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:46.524 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:46.524 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-osd.0.asok 2026-02-13T05:49:46.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-13T05:49:46.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-osd.0.asok log flush 2026-02-13T05:49:46.571 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:46.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_sse4' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:46.577 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:44.328+0000 7f0575fcbd80 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_sse4 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-13T05:49:46.578 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_sse4' td/test-erasure-code-plugins/osd.0.log 2026-02-13T05:49:46.579 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:45.436+0000 7f0fe7a0e900 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_sse4 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-13T05:49:46.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-13T05:49:46.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:46.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:46.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:46.580 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:46.580 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:46.581 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:46.581 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:46.581 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:46.686 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:46.686 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:46.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:46.688 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:46.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:46.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:46.689 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:46.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:46.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:46.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:46.691 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:46.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:46.693 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:46.693 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:46.696 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:46.696 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:46.696 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:46.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:46.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:46.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:46.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-13T05:49:46.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-13T05:49:46.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:46.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-13T05:49:46.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:46.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:46.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:46.698 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:46.698 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:46.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:46.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:46.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:46.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:46.699 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:46.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:46.700 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:46.701 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:46.701 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:46.702 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:46.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:46.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:46.703 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:46.703 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:46.703 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:46.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:46.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:46.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:46.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:46.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:46.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:46.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:46.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:46.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-13T05:49:46.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:46.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:46.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:46.708 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18932 2026-02-13T05:49:46.710 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:46.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:49:46.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:46.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-13T05:49:46.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=shec_generic 2026-02-13T05:49:46.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:46.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:46.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:46.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:46.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-13T05:49:46.712 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=shec_generic 2026-02-13T05:49:46.730 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:46.731 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:46.731 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:46.731 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:46.731 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:46.731 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:46.731 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:46.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=shec_generic 2026-02-13T05:49:46.756 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:46.758 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:46.758 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:46.759 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:46.759 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:46.759 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:46.759 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:46.759 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:46.759 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:46.759 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:46.759 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:46.759 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:46.759 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:46.760 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:46.760 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get fsid 2026-02-13T05:49:46.803 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:46.803 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:46.803 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:46.803 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:46.803 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:46.803 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:46.804 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:46.804 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:46.804 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:46.804 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:46.804 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:46.804 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:46.804 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:46.804 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:46.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-13T05:49:46.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:46.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:46.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:46.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:46.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-13T05:49:46.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:46.948 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:46.948 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:46.949 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:46.949 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:46.949 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:46.949 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:46.949 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:46.949 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:46.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:46.966 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-13T05:49:46.966 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:46.966 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:46.966 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:46.966 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:46.966 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:46.966 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:46.967 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-13T05:49:46.967 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:47.005 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:47.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=shec_generic 2026-02-13T05:49:47.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:47.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:47.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:47.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:47.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-13T05:49:47.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:47.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:47.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:47.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:47.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-13T05:49:47.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-13T05:49:47.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:47.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:47.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:47.013 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:47.013 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:47.013 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:47.013 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:47.013 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:47.013 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:47.013 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:47.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:47.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:47.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:47.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:47.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:47.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:47.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:47.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:47.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:47.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:47.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:47.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=shec_generic 2026-02-13T05:49:47.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-13T05:49:47.015 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:47.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d9561c6f-43e1-4afc-8839-8479d4907a08 2026-02-13T05:49:47.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d9561c6f-43e1-4afc-8839-8479d4907a08' 2026-02-13T05:49:47.016 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 d9561c6f-43e1-4afc-8839-8479d4907a08 2026-02-13T05:49:47.016 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:47.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB7u45plJ1lARAASFyDNgED16F6zjIF6G1E/A== 2026-02-13T05:49:47.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB7u45plJ1lARAASFyDNgED16F6zjIF6G1E/A=="}' 2026-02-13T05:49:47.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d9561c6f-43e1-4afc-8839-8479d4907a08 -i td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:47.125 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:47.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:47.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_generic --mkfs --key AQB7u45plJ1lARAASFyDNgED16F6zjIF6G1E/A== --osd-uuid d9561c6f-43e1-4afc-8839-8479d4907a08 2026-02-13T05:49:47.151 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:47.150+0000 7fd01b2ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:47.152 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:47.152+0000 7fd01b2ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:47.153 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:47.153+0000 7fd01b2ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:47.153 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:47.153+0000 7fd01b2ba900 -1 bdev(0x5604a49bec00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:47.154 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:47.153+0000 7fd01b2ba900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-13T05:49:47.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-13T05:49:47.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:47.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:47.553 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:47.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:47.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:47.658 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:47.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_generic 2026-02-13T05:49:47.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:47.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:47.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:47.675 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:47.675+0000 7efda99c1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:47.676 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:47.676+0000 7efda99c1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:47.677 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:47.677+0000 7efda99c1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:47.758 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:47.758 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:47.758 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:47.759 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:47.759 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:47.759 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:47.759 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:47.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:47.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:47.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:47.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:47.856 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:47.855+0000 7efda99c1900 -1 Falling back to public interface 2026-02-13T05:49:48.270 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:48.270+0000 7efda99c1900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:48.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:48.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:48.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:48.857 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:48.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:48.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:48.954 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2216990949,v1:127.0.0.1:6801/2216990949] [v2:127.0.0.1:6802/2216990949,v1:127.0.0.1:6803/2216990949] exists,up d9561c6f-43e1-4afc-8839-8479d4907a08 2026-02-13T05:49:48.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:48.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:48.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:48.956 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-13T05:49:48.956 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:49:48.956 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:49:48.956 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:48.956 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:48.956 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:48.957 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-osd.0.asok 2026-02-13T05:49:48.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-13T05:49:48.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-osd.0.asok log flush 2026-02-13T05:49:49.003 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:49.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_generic' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:49.008 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:46.747+0000 7ff4cea1fd80 0 WARNING: osd_erasure_code_plugins contains plugin shec_generic that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-13T05:49:49.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_generic' td/test-erasure-code-plugins/osd.0.log 2026-02-13T05:49:49.009 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:47.856+0000 7efda99c1900 0 WARNING: osd_erasure_code_plugins contains plugin shec_generic that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-13T05:49:49.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-13T05:49:49.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:49.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:49.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:49.011 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:49.011 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:49.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:49.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:49.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:49.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:49.117 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:49.118 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:49.118 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:49.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:49.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:49.120 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:49.121 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:49.121 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:49.121 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:49.122 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:49.122 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:49.123 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:49.123 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:49.126 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:49.126 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:49.126 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:49.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:49.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:49.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:49.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-13T05:49:49.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-13T05:49:49.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:49.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-13T05:49:49.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:49.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:49.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:49.129 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:49.129 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:49.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:49.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:49.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:49.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:49.130 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:49.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:49.130 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:49.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:49.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:49.132 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:49.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:49.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:49.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:49.133 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:49.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:49.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:49.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:49.135 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:49.135 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:49.136 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:49.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:49.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:49.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:49.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-13T05:49:49.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:49.138 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:49.138 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:49.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18932 2026-02-13T05:49:49.139 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:49.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:49:49.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:49.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-13T05:49:49.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=shec_sse3 2026-02-13T05:49:49.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:49.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:49.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:49.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:49.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-13T05:49:49.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=shec_sse3 2026-02-13T05:49:49.159 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:49.159 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:49.159 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:49.159 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:49.159 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:49.160 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:49.160 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:49.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=shec_sse3 2026-02-13T05:49:49.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:49.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:49.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:49.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:49.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:49.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:49.187 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:49.187 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:49.187 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:49.187 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:49.187 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:49.188 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:49.188 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:49.188 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:49.188 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get fsid 2026-02-13T05:49:49.232 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:49.232 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:49.232 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:49.232 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:49.232 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:49.233 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:49.233 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:49.234 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:49.234 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:49.234 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:49.234 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:49.234 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:49.234 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:49.234 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:49.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-13T05:49:49.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:49.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:49.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:49.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:49.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-13T05:49:49.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:49.377 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:49.377 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:49.377 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:49.377 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:49.378 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:49.378 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:49.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:49.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:49.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:49.396 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-13T05:49:49.396 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:49.396 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:49.396 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:49.396 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:49.396 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:49.396 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:49.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-13T05:49:49.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:49.437 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:49.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=shec_sse3 2026-02-13T05:49:49.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:49.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:49.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:49.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:49.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-13T05:49:49.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:49.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:49.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:49.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:49.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-13T05:49:49.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-13T05:49:49.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:49.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:49.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:49.446 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:49.446 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:49.446 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:49.446 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:49.446 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:49.446 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:49.446 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:49.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:49.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:49.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:49.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:49.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:49.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:49.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:49.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:49.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:49.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:49.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:49.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=shec_sse3 2026-02-13T05:49:49.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-13T05:49:49.447 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:49.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a3931ae8-dadc-4bde-a796-49dea9b84eeb 2026-02-13T05:49:49.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a3931ae8-dadc-4bde-a796-49dea9b84eeb' 2026-02-13T05:49:49.448 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 a3931ae8-dadc-4bde-a796-49dea9b84eeb 2026-02-13T05:49:49.449 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:49.456 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB9u45prowsGxAA7XOE9z4YHhrAEJOrhnPIXA== 2026-02-13T05:49:49.456 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB9u45prowsGxAA7XOE9z4YHhrAEJOrhnPIXA=="}' 2026-02-13T05:49:49.456 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a3931ae8-dadc-4bde-a796-49dea9b84eeb -i td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:49.560 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:49.566 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:49.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_sse3 --mkfs --key AQB9u45prowsGxAA7XOE9z4YHhrAEJOrhnPIXA== --osd-uuid a3931ae8-dadc-4bde-a796-49dea9b84eeb 2026-02-13T05:49:49.584 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:49.584+0000 7f0a2140d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:49.585 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:49.585+0000 7f0a2140d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:49.586 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:49.586+0000 7f0a2140d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:49.587 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:49.586+0000 7f0a2140d900 -1 bdev(0x565216924c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:49.587 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:49.586+0000 7f0a2140d900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-13T05:49:50.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-13T05:49:50.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:50.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:50.007 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:50.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:50.108 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:50.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:50.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_sse3 2026-02-13T05:49:50.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:50.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:50.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:50.125 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:50.125+0000 7efcd7df2900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:50.126 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:50.126+0000 7efcd7df2900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:50.127 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:50.127+0000 7efcd7df2900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:50.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:50.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:50.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:50.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:50.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:50.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:50.211 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:50.211 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:50.211 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:50.211 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:50.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:50.344 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:50.344+0000 7efcd7df2900 -1 Falling back to public interface 2026-02-13T05:49:50.702 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:50.702+0000 7efcd7df2900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:51.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:51.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:51.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:51.311 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:51.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:51.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:51.409 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2806715791,v1:127.0.0.1:6801/2806715791] [v2:127.0.0.1:6802/2806715791,v1:127.0.0.1:6803/2806715791] exists,up a3931ae8-dadc-4bde-a796-49dea9b84eeb 2026-02-13T05:49:51.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:51.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:51.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:51.410 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-13T05:49:51.410 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:49:51.410 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:49:51.411 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:51.411 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:51.411 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:51.411 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-osd.0.asok 2026-02-13T05:49:51.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-13T05:49:51.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-osd.0.asok log flush 2026-02-13T05:49:51.457 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:51.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_sse3' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:51.462 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:49.176+0000 7f0994210d80 0 WARNING: osd_erasure_code_plugins contains plugin shec_sse3 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-13T05:49:51.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_sse3' td/test-erasure-code-plugins/osd.0.log 2026-02-13T05:49:51.463 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:50.344+0000 7efcd7df2900 0 WARNING: osd_erasure_code_plugins contains plugin shec_sse3 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-13T05:49:51.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-13T05:49:51.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:51.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:51.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:51.465 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:51.465 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:51.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:51.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:51.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:51.571 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:51.572 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:51.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:51.573 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:51.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:51.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:51.575 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:51.575 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:51.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:51.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:51.576 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:51.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:51.578 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:51.578 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:51.581 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:51.581 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:51.581 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:51.581 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:51.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:51.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:51.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-13T05:49:51.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-13T05:49:51.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:51.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code-plugins 2026-02-13T05:49:51.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:51.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:51.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:51.584 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:51.584 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:51.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:51.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:51.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:51.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:51.585 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:51.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:51.585 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:51.586 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:51.586 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:51.587 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:51.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:51.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:51.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:51.588 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:51.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:51.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:51.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:51.591 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:51.591 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:51.591 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:51.591 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:51.591 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:51.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:51.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code-plugins 2026-02-13T05:49:51.593 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:51.593 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:51.593 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:51.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18932 2026-02-13T05:49:51.594 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:51.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:49:51.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:51.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-13T05:49:51.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=shec_sse4 2026-02-13T05:49:51.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:51.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:51.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:51.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:51.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-13T05:49:51.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=shec_sse4 2026-02-13T05:49:51.614 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:51.614 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:51.614 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:51.614 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:51.614 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:51.614 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:51.614 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:51.614 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=shec_sse4 2026-02-13T05:49:51.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:51.640 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:51.640 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:51.640 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:51.640 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:51.640 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:51.641 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:51.641 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:51.642 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:51.642 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:51.642 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:51.642 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:51.642 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:51.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:51.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get fsid 2026-02-13T05:49:51.684 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:51.685 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:51.685 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:51.685 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:51.685 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:51.686 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:51.686 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:51.686 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:51.686 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:51.686 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:51.687 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:51.687 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:51.687 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:51.687 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18932/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:51.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-13T05:49:51.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:51.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:51.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:51.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:51.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-13T05:49:51.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:51.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:51.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:51.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:51.830 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:51.830 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:51.830 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:51.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:51.831 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:51.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:51.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-13T05:49:51.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:51.849 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:51.849 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:51.849 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:51.849 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:51.849 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-mon.a.asok 2026-02-13T05:49:51.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-13T05:49:51.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-mon.a.asok log flush 2026-02-13T05:49:51.889 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:51.895 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=shec_sse4 2026-02-13T05:49:51.895 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:51.895 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:51.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:51.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:51.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-13T05:49:51.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-13T05:49:51.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:51.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:51.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:51.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-13T05:49:51.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-13T05:49:51.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:51.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:51.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-13T05:49:51.897 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:51.897 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:51.897 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:51.897 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:51.897 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:51.897 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:51.897 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:51.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' 2026-02-13T05:49:51.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:51.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:51.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:51.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-13T05:49:51.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-13T05:49:51.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:51.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:51.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:51.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:51.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:51.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_erasure_code_plugins=shec_sse4 2026-02-13T05:49:51.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-13T05:49:51.898 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:51.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3a395c89-fe34-4ff3-853d-1b8a5873bdd6 2026-02-13T05:49:51.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 3a395c89-fe34-4ff3-853d-1b8a5873bdd6' 2026-02-13T05:49:51.899 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 3a395c89-fe34-4ff3-853d-1b8a5873bdd6 2026-02-13T05:49:51.899 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:51.908 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB/u45pg20VNhAATjMCAJtH4ka0re2UOT8klQ== 2026-02-13T05:49:51.908 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB/u45pg20VNhAATjMCAJtH4ka0re2UOT8klQ=="}' 2026-02-13T05:49:51.908 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3a395c89-fe34-4ff3-853d-1b8a5873bdd6 -i td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:52.009 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:52.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-13T05:49:52.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_sse4 --mkfs --key AQB/u45pg20VNhAATjMCAJtH4ka0re2UOT8klQ== --osd-uuid 3a395c89-fe34-4ff3-853d-1b8a5873bdd6 2026-02-13T05:49:52.033 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:52.033+0000 7f366cb8a900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:52.035 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:52.035+0000 7f366cb8a900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:52.036 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:52.036+0000 7f366cb8a900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:52.036 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:52.036+0000 7f366cb8a900 -1 bdev(0x5579bafd8c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:52.036 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:52.036+0000 7f366cb8a900 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-13T05:49:52.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-13T05:49:52.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:52.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:52.430 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:52.430 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:52.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:52.534 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:52.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7f902049-1ead-483f-905e-ecd8a37f702a --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.18932/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_sse4 2026-02-13T05:49:52.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:52.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:52.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:52.550 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:52.550+0000 7f54ee2ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:52.551 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:52.551+0000 7f54ee2ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:52.552 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:52.552+0000 7f54ee2ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:52.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:52.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:52.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:52.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:52.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:52.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:52.632 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:52.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:52.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:52.636 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:52.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:52.806 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:52.806+0000 7f54ee2ba900 -1 Falling back to public interface 2026-02-13T05:49:53.256 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:53.255+0000 7f54ee2ba900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:53.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:53.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:53.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:53.731 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:53.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:53.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:53.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:54.833 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:54.834 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:54.834 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:49:54.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T05:49:54.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:54.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:55.058 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1804751705,v1:127.0.0.1:6801/1804751705] [v2:127.0.0.1:6802/1804751705,v1:127.0.0.1:6803/1804751705] exists,up 3a395c89-fe34-4ff3-853d-1b8a5873bdd6 2026-02-13T05:49:55.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:55.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:55.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:55.060 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-13T05:49:55.060 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:49:55.060 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:49:55.060 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:55.061 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:55.061 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:55.061 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18932/ceph-osd.0.asok 2026-02-13T05:49:55.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-13T05:49:55.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.18932/ceph-osd.0.asok log flush 2026-02-13T05:49:55.106 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:55.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_sse4' td/test-erasure-code-plugins/mon.a.log 2026-02-13T05:49:55.111 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:51.630+0000 7f94e5a5bd80 0 WARNING: osd_erasure_code_plugins contains plugin shec_sse4 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-13T05:49:55.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_sse4' td/test-erasure-code-plugins/osd.0.log 2026-02-13T05:49:55.112 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:52.806+0000 7f54ee2ba900 0 WARNING: osd_erasure_code_plugins contains plugin shec_sse4 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-13T05:49:55.113 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-13T05:49:55.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:55.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:55.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:55.114 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:55.114 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:55.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:55.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:55.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:55.220 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:55.220 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:55.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:55.221 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:55.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:55.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:55.223 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:55.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:55.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:55.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:55.225 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:55.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:55.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:55.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:55.229 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:55.230 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:55.230 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:55.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:55.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:55.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:55.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:54: TEST_preload_warning: return 0 2026-02-13T05:49:55.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-13T05:49:55.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/test-erasure-code-plugins 0 2026-02-13T05:49:55.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code-plugins 2026-02-13T05:49:55.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-13T05:49:55.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-13T05:49:55.232 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:55.232 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:55.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:55.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:55.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:55.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:55.233 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:55.234 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:55.234 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:55.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:55.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:55.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:55.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:55.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:55.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:55.237 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:55.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:55.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-13T05:49:55.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code-plugins 2026-02-13T05:49:55.239 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:55.239 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:55.239 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18932 2026-02-13T05:49:55.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18932 2026-02-13T05:49:55.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:55.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:55.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-13T05:49:55.242 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-13T05:49:55.242 DEBUG:teuthology.orchestra.run.trial024:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T05:49:55.267 INFO:tasks.workunit:Running workunit erasure-code/test-erasure-code.sh... 2026-02-13T05:49:55.268 DEBUG:teuthology.orchestra.run.trial024:workunit test erasure-code/test-erasure-code.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh 2026-02-13T05:49:55.330 INFO:tasks.workunit.client.0.trial024.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T05:49:55.336 INFO:tasks.workunit.client.0.trial024.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T05:49:55.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-13T05:49:55.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-13T05:49:55.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-13T05:49:55.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-13T05:49:55.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-13T05:49:55.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-13T05:49:55.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-13T05:49:55.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-13T05:49:55.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/test-erasure-code 2026-02-13T05:49:55.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:22: run: local dir=td/test-erasure-code 2026-02-13T05:49:55.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:23: run: shift 2026-02-13T05:49:55.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:25: run: export CEPH_MON=127.0.0.1:7101 2026-02-13T05:49:55.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:25: run: CEPH_MON=127.0.0.1:7101 2026-02-13T05:49:55.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:26: run: export CEPH_ARGS 2026-02-13T05:49:55.337 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:27: run: uuidgen 2026-02-13T05:49:55.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:27: run: CEPH_ARGS+='--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none ' 2026-02-13T05:49:55.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:49:55.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:30: run: setup td/test-erasure-code 2026-02-13T05:49:55.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-code 2026-02-13T05:49:55.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-code 2026-02-13T05:49:55.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code 2026-02-13T05:49:55.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:49:55.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code KILL 2026-02-13T05:49:55.338 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:49:55.338 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:49:55.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:49:55.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:49:55.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:49:55.340 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:49:55.340 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:49:55.340 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:49:55.340 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:49:55.340 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:49:55.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:49:55.341 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:49:55.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:55.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:49:55.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:49:55.341 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:49:55.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:49:55.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:49:55.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code 2026-02-13T05:49:55.343 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:49:55.343 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:55.343 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:49:55.343 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.44477 2026-02-13T05:49:55.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:49:55.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:49:55.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-code 2026-02-13T05:49:55.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:49:55.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:55.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:49:55.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.44477 2026-02-13T05:49:55.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:49:55.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T05:49:55.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T05:49:55.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:49:55.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-code 1' TERM HUP INT 2026-02-13T05:49:55.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:31: run: run_mon td/test-erasure-code a 2026-02-13T05:49:55.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-code 2026-02-13T05:49:55.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:49:55.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:49:55.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:49:55.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-code/a 2026-02-13T05:49:55.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code/a --run-dir=td/test-erasure-code 2026-02-13T05:49:55.366 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:49:55.366 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:55.366 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:55.366 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:55.366 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:55.367 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:49:55.367 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:49:55.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code/a '--log-file=td/test-erasure-code/$name.log' '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code/log --run-dir=td/test-erasure-code '--pid-file=td/test-erasure-code/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:49:55.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:49:55.393 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:49:55.394 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:55.394 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:55.394 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:49:55.394 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:49:55.394 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:55.394 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:55.395 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:55.395 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:55.395 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:55.395 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:49:55.395 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44477/ceph-mon.a.asok 2026-02-13T05:49:55.395 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:55.395 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.44477/ceph-mon.a.asok config get fsid 2026-02-13T05:49:55.442 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:49:55.442 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:49:55.442 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:49:55.442 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:49:55.442 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:49:55.442 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:49:55.442 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:55.442 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:55.443 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:55.443 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:55.443 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:49:55.443 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44477/ceph-mon.a.asok 2026-02-13T05:49:55.443 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:49:55.443 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.44477/ceph-mon.a.asok config get mon_host 2026-02-13T05:49:55.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:32: run: run_mgr td/test-erasure-code x 2026-02-13T05:49:55.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-code 2026-02-13T05:49:55.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:49:55.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:49:55.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:49:55.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-code/x 2026-02-13T05:49:55.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:49:55.584 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:49:55.584 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:55.584 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:55.584 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:55.584 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:55.584 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:49:55.584 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:49:55.585 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:55.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code/x '--log-file=td/test-erasure-code/$name.log' '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --run-dir=td/test-erasure-code '--pid-file=td/test-erasure-code/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:49:55.603 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:34: run: get_asok_path mon.a 2026-02-13T05:49:55.603 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:49:55.603 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:49:55.603 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:49:55.603 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:55.603 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:49:55.603 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44477/ceph-mon.a.asok 2026-02-13T05:49:55.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:34: run: CEPH_ARGS= 2026-02-13T05:49:55.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:34: run: ceph --admin-daemon /tmp/ceph-asok.44477/ceph-mon.a.asok log flush 2026-02-13T05:49:55.642 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:49:55.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:35: run: grep 'load: jerasure.*lrc' td/test-erasure-code/mon.a.log 2026-02-13T05:49:55.647 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:55.384+0000 7f458b3c7d80 0 load: jerasure load: lrc 2026-02-13T05:49:55.647 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: seq 0 10 2026-02-13T05:49:55.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-13T05:49:55.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 0 2026-02-13T05:49:55.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-13T05:49:55.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:55.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:49:55.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:55.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/0 2026-02-13T05:49:55.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:49:55.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:55.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:55.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:55.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/0' 2026-02-13T05:49:55.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/0/journal' 2026-02-13T05:49:55.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:55.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:55.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:49:55.653 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:55.653 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:55.653 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:55.653 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:55.653 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:55.653 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:49:55.653 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:49:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:49:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:49:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:49:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:49:55.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/0 2026-02-13T05:49:55.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:55.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=043f6946-4318-495e-bb79-dc0d23c4381b 2026-02-13T05:49:55.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 043f6946-4318-495e-bb79-dc0d23c4381b' 2026-02-13T05:49:55.655 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 043f6946-4318-495e-bb79-dc0d23c4381b 2026-02-13T05:49:55.656 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:55.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCDu45p1KGSJxAArRqlkYi3G/ASQE6hUDCyEg== 2026-02-13T05:49:55.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCDu45p1KGSJxAArRqlkYi3G/ASQE6hUDCyEg=="}' 2026-02-13T05:49:55.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 043f6946-4318-495e-bb79-dc0d23c4381b -i td/test-erasure-code/0/new.json 2026-02-13T05:49:55.766 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:55.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/0/new.json 2026-02-13T05:49:55.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/0 --osd-journal=td/test-erasure-code/0/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCDu45p1KGSJxAArRqlkYi3G/ASQE6hUDCyEg== --osd-uuid 043f6946-4318-495e-bb79-dc0d23c4381b 2026-02-13T05:49:55.791 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:55.791+0000 7f5bf3b70900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:55.793 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:55.793+0000 7f5bf3b70900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:55.794 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:55.794+0000 7f5bf3b70900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:55.794 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:55.794+0000 7f5bf3b70900 -1 bdev(0x5621af860c00 td/test-erasure-code/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:55.794 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:55.794+0000 7f5bf3b70900 -1 bluestore(td/test-erasure-code/0) _read_fsid unparsable uuid 2026-02-13T05:49:56.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/0/keyring 2026-02-13T05:49:56.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:56.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:49:56.201 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:49:56.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:56.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:49:56.306 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:49:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/0 --osd-journal=td/test-erasure-code/0/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:49:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:56.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:56.322 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:56.322+0000 7f0b911f4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:56.323 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:56.323+0000 7f0b911f4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:56.324 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:56.324+0000 7f0b911f4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:56.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:49:56.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:56.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:49:56.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:56.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:56.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:56.408 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:56.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:56.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:56.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:56.504 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:56.532 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:56.532+0000 7f0b911f4900 -1 Falling back to public interface 2026-02-13T05:49:56.873 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:56.873+0000 7f0b911f4900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:49:57.506 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:57.506 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:57.506 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:57.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:57.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:57.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:49:57.605 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/543286001,v1:127.0.0.1:6801/543286001] [v2:127.0.0.1:6802/543286001,v1:127.0.0.1:6803/543286001] exists,up 043f6946-4318-495e-bb79-dc0d23c4381b 2026-02-13T05:49:57.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:49:57.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:49:57.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:49:57.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-13T05:49:57.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 1 2026-02-13T05:49:57.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-13T05:49:57.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:49:57.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:49:57.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:49:57.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/1 2026-02-13T05:49:57.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:49:57.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:49:57.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:49:57.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:49:57.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/1' 2026-02-13T05:49:57.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/1/journal' 2026-02-13T05:49:57.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:49:57.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:49:57.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:49:57.610 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:49:57.610 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:49:57.610 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:49:57.610 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:49:57.610 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:49:57.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:49:57.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:49:57.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/1 2026-02-13T05:49:57.612 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:49:57.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7384e4b8-8470-4679-9708-01d73e412ca7 2026-02-13T05:49:57.612 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 7384e4b8-8470-4679-9708-01d73e412ca7 2026-02-13T05:49:57.613 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 7384e4b8-8470-4679-9708-01d73e412ca7' 2026-02-13T05:49:57.613 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:49:57.622 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCFu45pTpUIJRAAP8b5r5Iu7Z0R26/O9fceJg== 2026-02-13T05:49:57.622 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCFu45pTpUIJRAAP8b5r5Iu7Z0R26/O9fceJg=="}' 2026-02-13T05:49:57.622 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7384e4b8-8470-4679-9708-01d73e412ca7 -i td/test-erasure-code/1/new.json 2026-02-13T05:49:57.725 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:57.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/1/new.json 2026-02-13T05:49:57.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/1 --osd-journal=td/test-erasure-code/1/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCFu45pTpUIJRAAP8b5r5Iu7Z0R26/O9fceJg== --osd-uuid 7384e4b8-8470-4679-9708-01d73e412ca7 2026-02-13T05:49:57.750 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:57.750+0000 7f0ae6e16900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:57.752 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:57.752+0000 7f0ae6e16900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:57.753 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:57.753+0000 7f0ae6e16900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:57.753 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:57.753+0000 7f0ae6e16900 -1 bdev(0x556bd8a12c00 td/test-erasure-code/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:49:57.753 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:57.753+0000 7f0ae6e16900 -1 bluestore(td/test-erasure-code/1) _read_fsid unparsable uuid 2026-02-13T05:49:58.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/1/keyring 2026-02-13T05:49:58.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:49:58.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:49:58.082 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:49:58.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:49:58.392 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:49:58.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:49:58.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/1 --osd-journal=td/test-erasure-code/1/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:49:58.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:49:58.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:49:58.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:49:58.409 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:58.409+0000 7f66e11a4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:58.411 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:58.411+0000 7f66e11a4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:58.412 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:58.412+0000 7f66e11a4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:49:58.572 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:58.572+0000 7f66e11a4900 -1 Falling back to public interface 2026-02-13T05:49:58.620 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:49:58.620 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:49:58.620 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:49:58.620 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:49:58.620 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:49:58.621 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:58.621 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:49:58.621 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:49:58.621 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:58.622 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:49:58.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:49:58.921 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:49:58.921+0000 7f66e11a4900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:49:59.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:49:59.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:49:59.847 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:49:59.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:49:59.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:49:59.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:50:00.067 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/536878225,v1:127.0.0.1:6811/536878225] [v2:127.0.0.1:6812/536878225,v1:127.0.0.1:6813/536878225] exists,up 7384e4b8-8470-4679-9708-01d73e412ca7 2026-02-13T05:50:00.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:00.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:00.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:00.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-13T05:50:00.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 2 2026-02-13T05:50:00.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-13T05:50:00.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:50:00.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:50:00.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:50:00.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/2 2026-02-13T05:50:00.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:50:00.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:50:00.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:50:00.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:50:00.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/2' 2026-02-13T05:50:00.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/2/journal' 2026-02-13T05:50:00.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:50:00.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:50:00.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:50:00.073 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:50:00.073 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:50:00.073 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:50:00.073 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:50:00.073 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:00.073 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:00.073 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:00.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:00.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:50:00.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:50:00.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:50:00.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:50:00.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:50:00.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:50:00.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:50:00.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:50:00.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:50:00.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:50:00.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:50:00.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/2 2026-02-13T05:50:00.074 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:50:00.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b1a76caf-d6f7-49bb-b0b6-deb6230be2d9 2026-02-13T05:50:00.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 b1a76caf-d6f7-49bb-b0b6-deb6230be2d9' 2026-02-13T05:50:00.075 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 b1a76caf-d6f7-49bb-b0b6-deb6230be2d9 2026-02-13T05:50:00.075 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:50:00.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCIu45phyz0BBAAp6FlduFgYPJNjGxFXUqL2g== 2026-02-13T05:50:00.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCIu45phyz0BBAAp6FlduFgYPJNjGxFXUqL2g=="}' 2026-02-13T05:50:00.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b1a76caf-d6f7-49bb-b0b6-deb6230be2d9 -i td/test-erasure-code/2/new.json 2026-02-13T05:50:00.311 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:50:00.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/2/new.json 2026-02-13T05:50:00.320 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/2 --osd-journal=td/test-erasure-code/2/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCIu45phyz0BBAAp6FlduFgYPJNjGxFXUqL2g== --osd-uuid b1a76caf-d6f7-49bb-b0b6-deb6230be2d9 2026-02-13T05:50:00.338 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:00.338+0000 7f499e60f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:00.339 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:00.339+0000 7f499e60f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:00.340 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:00.340+0000 7f499e60f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:00.341 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:00.340+0000 7f499e60f900 -1 bdev(0x55f31f20cc00 td/test-erasure-code/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:50:00.341 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:00.341+0000 7f499e60f900 -1 bluestore(td/test-erasure-code/2) _read_fsid unparsable uuid 2026-02-13T05:50:00.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/2/keyring 2026-02-13T05:50:00.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:50:00.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:50:00.659 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:50:00.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:50:00.972 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:50:00.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:50:00.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/2 --osd-journal=td/test-erasure-code/2/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:50:00.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:50:00.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:50:00.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:50:00.988 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:00.988+0000 7f5abc653900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:00.990 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:00.990+0000 7f5abc653900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:00.991 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:00.991+0000 7f5abc653900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:01.117 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:01.116+0000 7f5abc653900 -1 Falling back to public interface 2026-02-13T05:50:01.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:50:01.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:50:01.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:50:01.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:50:01.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:50:01.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:01.205 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:50:01.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:50:01.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:01.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:50:01.430 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:50:01.440 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:01.440+0000 7f5abc653900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:50:02.431 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:50:02.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:02.432 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:50:02.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:50:02.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:02.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:50:02.665 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/29505074,v1:127.0.0.1:6819/29505074] [v2:127.0.0.1:6820/29505074,v1:127.0.0.1:6821/29505074] exists,up b1a76caf-d6f7-49bb-b0b6-deb6230be2d9 2026-02-13T05:50:02.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:02.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:02.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:02.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-13T05:50:02.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 3 2026-02-13T05:50:02.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-13T05:50:02.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:50:02.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T05:50:02.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:50:02.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/3 2026-02-13T05:50:02.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:50:02.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:50:02.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:50:02.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:50:02.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/3' 2026-02-13T05:50:02.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/3/journal' 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:50:02.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/3 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5ed6723b-8f74-452c-9720-fbde4eabaa42 2026-02-13T05:50:02.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 5ed6723b-8f74-452c-9720-fbde4eabaa42' 2026-02-13T05:50:02.673 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 5ed6723b-8f74-452c-9720-fbde4eabaa42 2026-02-13T05:50:02.673 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:50:02.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCKu45pimKTKBAAbKaFi1c4Le6kfZ3LGQtV0A== 2026-02-13T05:50:02.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCKu45pimKTKBAAbKaFi1c4Le6kfZ3LGQtV0A=="}' 2026-02-13T05:50:02.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5ed6723b-8f74-452c-9720-fbde4eabaa42 -i td/test-erasure-code/3/new.json 2026-02-13T05:50:02.908 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T05:50:02.916 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/3/new.json 2026-02-13T05:50:02.916 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/3 --osd-journal=td/test-erasure-code/3/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCKu45pimKTKBAAbKaFi1c4Le6kfZ3LGQtV0A== --osd-uuid 5ed6723b-8f74-452c-9720-fbde4eabaa42 2026-02-13T05:50:02.935 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:02.934+0000 7f965aa12900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:02.936 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:02.936+0000 7f965aa12900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:02.938 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:02.937+0000 7f965aa12900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:02.938 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:02.937+0000 7f965aa12900 -1 bdev(0x55bf57a06c00 td/test-erasure-code/3/block) open stat got: (1) Operation not permitted 2026-02-13T05:50:02.938 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:02.937+0000 7f965aa12900 -1 bluestore(td/test-erasure-code/3) _read_fsid unparsable uuid 2026-02-13T05:50:03.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/3/keyring 2026-02-13T05:50:03.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:50:03.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T05:50:03.278 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T05:50:03.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:50:03.591 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T05:50:03.591 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:50:03.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/3 --osd-journal=td/test-erasure-code/3/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:50:03.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:50:03.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:50:03.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:50:03.608 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:03.608+0000 7f01bbdc6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:03.609 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:03.609+0000 7f01bbdc6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:03.610 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:03.610+0000 7f01bbdc6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:03.738 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:03.737+0000 7f01bbdc6900 -1 Falling back to public interface 2026-02-13T05:50:03.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T05:50:03.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:50:03.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:50:03.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:50:03.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:50:03.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:03.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:50:03.818 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:50:03.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:03.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:50:04.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:50:04.062 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:04.062+0000 7f01bbdc6900 -1 osd.3 0 log_to_monitors true 2026-02-13T05:50:05.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:50:05.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:05.046 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:50:05.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:50:05.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:05.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:50:05.267 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/238323754,v1:127.0.0.1:6827/238323754] [v2:127.0.0.1:6828/238323754,v1:127.0.0.1:6829/238323754] exists,up 5ed6723b-8f74-452c-9720-fbde4eabaa42 2026-02-13T05:50:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-13T05:50:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 4 2026-02-13T05:50:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-13T05:50:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:50:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-13T05:50:05.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:50:05.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/4 2026-02-13T05:50:05.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:50:05.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:50:05.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:50:05.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:50:05.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/4' 2026-02-13T05:50:05.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/4/journal' 2026-02-13T05:50:05.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:50:05.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:50:05.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:50:05.272 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:50:05.273 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:50:05.273 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:50:05.273 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:50:05.273 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:05.273 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:05.273 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:05.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:05.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:50:05.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:50:05.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:50:05.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:50:05.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:50:05.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:50:05.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:50:05.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:50:05.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:50:05.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:50:05.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:50:05.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/4 2026-02-13T05:50:05.274 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:50:05.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3a5275fb-f3da-445d-a1c8-698f07184728 2026-02-13T05:50:05.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 3a5275fb-f3da-445d-a1c8-698f07184728' 2026-02-13T05:50:05.275 INFO:tasks.workunit.client.0.trial024.stdout:add osd4 3a5275fb-f3da-445d-a1c8-698f07184728 2026-02-13T05:50:05.275 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:50:05.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCNu45pFrbTEBAAvM1Fu1BnNAHrT/U0dmSzvQ== 2026-02-13T05:50:05.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCNu45pFrbTEBAAvM1Fu1BnNAHrT/U0dmSzvQ=="}' 2026-02-13T05:50:05.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3a5275fb-f3da-445d-a1c8-698f07184728 -i td/test-erasure-code/4/new.json 2026-02-13T05:50:05.508 INFO:tasks.workunit.client.0.trial024.stdout:4 2026-02-13T05:50:05.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/4/new.json 2026-02-13T05:50:05.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/4 --osd-journal=td/test-erasure-code/4/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCNu45pFrbTEBAAvM1Fu1BnNAHrT/U0dmSzvQ== --osd-uuid 3a5275fb-f3da-445d-a1c8-698f07184728 2026-02-13T05:50:05.535 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:05.534+0000 7fc2be7b0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:05.536 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:05.536+0000 7fc2be7b0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:05.537 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:05.537+0000 7fc2be7b0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:05.538 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:05.538+0000 7fc2be7b0900 -1 bdev(0x556b181f2c00 td/test-erasure-code/4/block) open stat got: (1) Operation not permitted 2026-02-13T05:50:05.538 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:05.538+0000 7fc2be7b0900 -1 bluestore(td/test-erasure-code/4) _read_fsid unparsable uuid 2026-02-13T05:50:05.876 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/4/keyring 2026-02-13T05:50:05.876 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:50:05.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-13T05:50:05.877 INFO:tasks.workunit.client.0.trial024.stdout:adding osd4 key to auth repository 2026-02-13T05:50:05.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:50:06.189 INFO:tasks.workunit.client.0.trial024.stdout:start osd.4 2026-02-13T05:50:06.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-13T05:50:06.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/4 --osd-journal=td/test-erasure-code/4/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:50:06.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:50:06.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:50:06.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:50:06.206 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:06.205+0000 7f3a6f364900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:06.207 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:06.206+0000 7f3a6f364900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:06.208 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:06.207+0000 7f3a6f364900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:06.341 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:06.339+0000 7f3a6f364900 -1 Falling back to public interface 2026-02-13T05:50:06.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-13T05:50:06.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:50:06.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-13T05:50:06.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:50:06.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:50:06.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:06.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:50:06.415 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:50:06.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:06.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:50:06.632 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:06.631+0000 7f3a6f364900 -1 osd.4 0 log_to_monitors true 2026-02-13T05:50:06.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:50:07.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:50:07.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:07.640 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:50:07.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:50:07.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:07.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:50:07.862 INFO:tasks.workunit.client.0.trial024.stdout:osd.4 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/4103262182,v1:127.0.0.1:6835/4103262182] [v2:127.0.0.1:6836/4103262182,v1:127.0.0.1:6837/4103262182] exists,up 3a5275fb-f3da-445d-a1c8-698f07184728 2026-02-13T05:50:07.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:07.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:07.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:07.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-13T05:50:07.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 5 2026-02-13T05:50:07.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-13T05:50:07.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:50:07.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-13T05:50:07.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:50:07.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/5 2026-02-13T05:50:07.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:50:07.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:50:07.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:50:07.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:50:07.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/5' 2026-02-13T05:50:07.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/5/journal' 2026-02-13T05:50:07.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:50:07.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:50:07.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:50:07.867 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:50:07.867 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:50:07.867 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:50:07.867 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:50:07.868 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:07.868 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:07.868 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:07.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:07.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:50:07.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:50:07.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:50:07.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:50:07.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:50:07.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:50:07.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:50:07.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:50:07.869 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:50:07.869 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:50:07.869 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:50:07.869 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/5 2026-02-13T05:50:07.869 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:50:07.869 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f6b8e3d8-c145-4442-947d-df83693722b6 2026-02-13T05:50:07.870 INFO:tasks.workunit.client.0.trial024.stdout:add osd5 f6b8e3d8-c145-4442-947d-df83693722b6 2026-02-13T05:50:07.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 f6b8e3d8-c145-4442-947d-df83693722b6' 2026-02-13T05:50:07.870 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:50:07.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCPu45pPbpbNBAA7gQOqXJMaI2Dt+FkgMsVRg== 2026-02-13T05:50:07.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCPu45pPbpbNBAA7gQOqXJMaI2Dt+FkgMsVRg=="}' 2026-02-13T05:50:07.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f6b8e3d8-c145-4442-947d-df83693722b6 -i td/test-erasure-code/5/new.json 2026-02-13T05:50:08.105 INFO:tasks.workunit.client.0.trial024.stdout:5 2026-02-13T05:50:08.113 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/5/new.json 2026-02-13T05:50:08.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/5 --osd-journal=td/test-erasure-code/5/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCPu45pPbpbNBAA7gQOqXJMaI2Dt+FkgMsVRg== --osd-uuid f6b8e3d8-c145-4442-947d-df83693722b6 2026-02-13T05:50:08.133 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:08.132+0000 7f8841c97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:08.134 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:08.133+0000 7f8841c97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:08.135 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:08.134+0000 7f8841c97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:08.136 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:08.135+0000 7f8841c97900 -1 bdev(0x5626f484ec00 td/test-erasure-code/5/block) open stat got: (1) Operation not permitted 2026-02-13T05:50:08.136 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:08.135+0000 7f8841c97900 -1 bluestore(td/test-erasure-code/5) _read_fsid unparsable uuid 2026-02-13T05:50:08.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/5/keyring 2026-02-13T05:50:08.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:50:08.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-13T05:50:08.474 INFO:tasks.workunit.client.0.trial024.stdout:adding osd5 key to auth repository 2026-02-13T05:50:08.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:50:08.790 INFO:tasks.workunit.client.0.trial024.stdout:start osd.5 2026-02-13T05:50:08.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-13T05:50:08.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/5 --osd-journal=td/test-erasure-code/5/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:50:08.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:50:08.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:50:08.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:50:08.806 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:08.805+0000 7f76a5175900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:08.807 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:08.806+0000 7f76a5175900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:08.808 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:08.807+0000 7f76a5175900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:08.953 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:08.951+0000 7f76a5175900 -1 Falling back to public interface 2026-02-13T05:50:09.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-13T05:50:09.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:50:09.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-13T05:50:09.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:50:09.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:50:09.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:09.016 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:50:09.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:50:09.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:09.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:50:09.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:50:09.251 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:09.250+0000 7f76a5175900 -1 osd.5 0 log_to_monitors true 2026-02-13T05:50:10.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:50:10.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:10.244 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:50:10.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:50:10.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:10.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:50:10.467 INFO:tasks.workunit.client.0.trial024.stdout:osd.5 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/1045741911,v1:127.0.0.1:6843/1045741911] [v2:127.0.0.1:6844/1045741911,v1:127.0.0.1:6845/1045741911] exists,up f6b8e3d8-c145-4442-947d-df83693722b6 2026-02-13T05:50:10.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:10.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:10.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:10.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-13T05:50:10.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 6 2026-02-13T05:50:10.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-13T05:50:10.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:50:10.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-13T05:50:10.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:50:10.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/6 2026-02-13T05:50:10.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:50:10.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:50:10.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:50:10.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:50:10.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/6' 2026-02-13T05:50:10.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/6/journal' 2026-02-13T05:50:10.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:50:10.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:50:10.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:50:10.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:50:10.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:50:10.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:50:10.473 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:50:10.473 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:10.473 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:10.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:10.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:10.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/6 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:50:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=854efcac-ea28-41df-9bfc-0e57b118f2ff 2026-02-13T05:50:10.475 INFO:tasks.workunit.client.0.trial024.stdout:add osd6 854efcac-ea28-41df-9bfc-0e57b118f2ff 2026-02-13T05:50:10.475 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 854efcac-ea28-41df-9bfc-0e57b118f2ff' 2026-02-13T05:50:10.475 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:50:10.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCSu45pQZHIHBAAultHXBkOl/SukADJzzT4Zg== 2026-02-13T05:50:10.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCSu45pQZHIHBAAultHXBkOl/SukADJzzT4Zg=="}' 2026-02-13T05:50:10.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 854efcac-ea28-41df-9bfc-0e57b118f2ff -i td/test-erasure-code/6/new.json 2026-02-13T05:50:10.711 INFO:tasks.workunit.client.0.trial024.stdout:6 2026-02-13T05:50:10.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/6/new.json 2026-02-13T05:50:10.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/6 --osd-journal=td/test-erasure-code/6/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCSu45pQZHIHBAAultHXBkOl/SukADJzzT4Zg== --osd-uuid 854efcac-ea28-41df-9bfc-0e57b118f2ff 2026-02-13T05:50:10.737 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:10.735+0000 7f88fe615900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:10.738 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:10.737+0000 7f88fe615900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:10.739 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:10.738+0000 7f88fe615900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:10.739 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:10.738+0000 7f88fe615900 -1 bdev(0x5646bdd3ac00 td/test-erasure-code/6/block) open stat got: (1) Operation not permitted 2026-02-13T05:50:10.739 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:10.738+0000 7f88fe615900 -1 bluestore(td/test-erasure-code/6) _read_fsid unparsable uuid 2026-02-13T05:50:11.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/6/keyring 2026-02-13T05:50:11.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:50:11.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-13T05:50:11.065 INFO:tasks.workunit.client.0.trial024.stdout:adding osd6 key to auth repository 2026-02-13T05:50:11.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:50:11.376 INFO:tasks.workunit.client.0.trial024.stdout:start osd.6 2026-02-13T05:50:11.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-13T05:50:11.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/6 --osd-journal=td/test-erasure-code/6/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:50:11.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:50:11.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:50:11.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:50:11.392 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:11.391+0000 7f286e93d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:11.394 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:11.393+0000 7f286e93d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:11.395 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:11.394+0000 7f286e93d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:11.554 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:11.553+0000 7f286e93d900 -1 Falling back to public interface 2026-02-13T05:50:11.598 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-13T05:50:11.598 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:50:11.598 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-13T05:50:11.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:50:11.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:50:11.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:11.599 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:50:11.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:50:11.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:11.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:50:11.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:50:11.865 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:11.864+0000 7f286e93d900 -1 osd.6 0 log_to_monitors true 2026-02-13T05:50:12.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:50:12.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:12.828 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:50:12.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:50:12.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:12.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:50:13.051 INFO:tasks.workunit.client.0.trial024.stdout:osd.6 up in weight 1 up_from 29 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/3828985546,v1:127.0.0.1:6851/3828985546] [v2:127.0.0.1:6852/3828985546,v1:127.0.0.1:6853/3828985546] exists,up 854efcac-ea28-41df-9bfc-0e57b118f2ff 2026-02-13T05:50:13.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:13.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:13.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:13.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-13T05:50:13.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 7 2026-02-13T05:50:13.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-13T05:50:13.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:50:13.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=7 2026-02-13T05:50:13.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:50:13.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/7 2026-02-13T05:50:13.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/7' 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/7/journal' 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:50:13.056 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:13.057 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:13.057 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:13.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:13.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:50:13.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:50:13.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:50:13.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:50:13.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:50:13.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:50:13.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:50:13.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:50:13.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:50:13.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:50:13.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:50:13.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/7 2026-02-13T05:50:13.058 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:50:13.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6b86b765-09e1-4591-90a3-02b927f64c1a 2026-02-13T05:50:13.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd7 6b86b765-09e1-4591-90a3-02b927f64c1a' 2026-02-13T05:50:13.058 INFO:tasks.workunit.client.0.trial024.stdout:add osd7 6b86b765-09e1-4591-90a3-02b927f64c1a 2026-02-13T05:50:13.059 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:50:13.066 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCVu45pim/0AxAAoRN92xfRIlfhQongDG3LpA== 2026-02-13T05:50:13.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCVu45pim/0AxAAoRN92xfRIlfhQongDG3LpA=="}' 2026-02-13T05:50:13.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6b86b765-09e1-4591-90a3-02b927f64c1a -i td/test-erasure-code/7/new.json 2026-02-13T05:50:13.292 INFO:tasks.workunit.client.0.trial024.stdout:7 2026-02-13T05:50:13.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/7/new.json 2026-02-13T05:50:13.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 7 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/7 --osd-journal=td/test-erasure-code/7/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCVu45pim/0AxAAoRN92xfRIlfhQongDG3LpA== --osd-uuid 6b86b765-09e1-4591-90a3-02b927f64c1a 2026-02-13T05:50:13.320 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:13.318+0000 7f4bc3c0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:13.321 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:13.320+0000 7f4bc3c0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:13.322 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:13.321+0000 7f4bc3c0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:13.323 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:13.321+0000 7f4bc3c0c900 -1 bdev(0x5616809fac00 td/test-erasure-code/7/block) open stat got: (1) Operation not permitted 2026-02-13T05:50:13.323 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:13.321+0000 7f4bc3c0c900 -1 bluestore(td/test-erasure-code/7) _read_fsid unparsable uuid 2026-02-13T05:50:13.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/7/keyring 2026-02-13T05:50:13.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:50:13.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd7 key to auth repository 2026-02-13T05:50:13.648 INFO:tasks.workunit.client.0.trial024.stdout:adding osd7 key to auth repository 2026-02-13T05:50:13.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:50:13.961 INFO:tasks.workunit.client.0.trial024.stdout:start osd.7 2026-02-13T05:50:13.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.7 2026-02-13T05:50:13.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 7 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/7 --osd-journal=td/test-erasure-code/7/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:50:13.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:50:13.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:50:13.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:50:13.978 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:13.977+0000 7f1b90a1b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:13.979 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:13.978+0000 7f1b90a1b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:13.980 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:13.979+0000 7f1b90a1b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:14.109 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:14.108+0000 7f1b90a1b900 -1 Falling back to public interface 2026-02-13T05:50:14.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 7 2026-02-13T05:50:14.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:50:14.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=7 2026-02-13T05:50:14.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:50:14.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:50:14.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:14.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:50:14.189 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:50:14.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:14.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-13T05:50:14.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:50:14.459 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:14.458+0000 7f1b90a1b900 -1 osd.7 0 log_to_monitors true 2026-02-13T05:50:15.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:50:15.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:15.413 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:50:15.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:50:15.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:15.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-13T05:50:15.638 INFO:tasks.workunit.client.0.trial024.stdout:osd.7 up in weight 1 up_from 33 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/767333945,v1:127.0.0.1:6859/767333945] [v2:127.0.0.1:6860/767333945,v1:127.0.0.1:6861/767333945] exists,up 6b86b765-09e1-4591-90a3-02b927f64c1a 2026-02-13T05:50:15.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:15.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:15.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:15.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-13T05:50:15.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 8 2026-02-13T05:50:15.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-13T05:50:15.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:50:15.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=8 2026-02-13T05:50:15.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:50:15.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/8 2026-02-13T05:50:15.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:50:15.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:50:15.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:50:15.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:50:15.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/8' 2026-02-13T05:50:15.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/8/journal' 2026-02-13T05:50:15.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:50:15.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:50:15.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:50:15.643 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:50:15.643 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:50:15.644 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:50:15.644 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:50:15.644 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:15.644 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:15.644 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:15.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:15.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:50:15.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:50:15.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:50:15.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:50:15.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:50:15.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:50:15.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:50:15.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:50:15.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:50:15.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:50:15.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:50:15.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/8 2026-02-13T05:50:15.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:50:15.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d2178b85-0a8c-47e6-ac1b-686dd74b745a 2026-02-13T05:50:15.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd8 d2178b85-0a8c-47e6-ac1b-686dd74b745a' 2026-02-13T05:50:15.646 INFO:tasks.workunit.client.0.trial024.stdout:add osd8 d2178b85-0a8c-47e6-ac1b-686dd74b745a 2026-02-13T05:50:15.646 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:50:15.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCXu45pIGL6JhAAheZ+Td07oWz8C4kwAmunLg== 2026-02-13T05:50:15.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCXu45pIGL6JhAAheZ+Td07oWz8C4kwAmunLg=="}' 2026-02-13T05:50:15.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d2178b85-0a8c-47e6-ac1b-686dd74b745a -i td/test-erasure-code/8/new.json 2026-02-13T05:50:15.880 INFO:tasks.workunit.client.0.trial024.stdout:8 2026-02-13T05:50:15.888 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/8/new.json 2026-02-13T05:50:15.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 8 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/8 --osd-journal=td/test-erasure-code/8/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCXu45pIGL6JhAAheZ+Td07oWz8C4kwAmunLg== --osd-uuid d2178b85-0a8c-47e6-ac1b-686dd74b745a 2026-02-13T05:50:15.907 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:15.905+0000 7f1401a15900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:15.908 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:15.907+0000 7f1401a15900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:15.909 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:15.908+0000 7f1401a15900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:15.909 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:15.908+0000 7f1401a15900 -1 bdev(0x5633e8546c00 td/test-erasure-code/8/block) open stat got: (1) Operation not permitted 2026-02-13T05:50:15.909 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:15.908+0000 7f1401a15900 -1 bluestore(td/test-erasure-code/8) _read_fsid unparsable uuid 2026-02-13T05:50:16.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/8/keyring 2026-02-13T05:50:16.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:50:16.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd8 key to auth repository 2026-02-13T05:50:16.226 INFO:tasks.workunit.client.0.trial024.stdout:adding osd8 key to auth repository 2026-02-13T05:50:16.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:50:16.538 INFO:tasks.workunit.client.0.trial024.stdout:start osd.8 2026-02-13T05:50:16.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.8 2026-02-13T05:50:16.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 8 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/8 --osd-journal=td/test-erasure-code/8/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:50:16.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:50:16.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:50:16.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:50:16.555 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:16.553+0000 7f7018990900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:16.556 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:16.555+0000 7f7018990900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:16.557 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:16.556+0000 7f7018990900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:16.706 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:16.704+0000 7f7018990900 -1 Falling back to public interface 2026-02-13T05:50:16.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 8 2026-02-13T05:50:16.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:50:16.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=8 2026-02-13T05:50:16.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:50:16.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:50:16.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:16.762 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:50:16.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:50:16.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:16.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-13T05:50:16.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:50:17.010 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:17.009+0000 7f7018990900 -1 osd.8 0 log_to_monitors true 2026-02-13T05:50:17.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:50:17.993 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:17.993 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:50:17.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:50:17.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:17.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-13T05:50:18.219 INFO:tasks.workunit.client.0.trial024.stdout:osd.8 up in weight 1 up_from 37 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/1195276199,v1:127.0.0.1:6867/1195276199] [v2:127.0.0.1:6868/1195276199,v1:127.0.0.1:6869/1195276199] exists,up d2178b85-0a8c-47e6-ac1b-686dd74b745a 2026-02-13T05:50:18.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:18.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:18.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:18.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-13T05:50:18.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 9 2026-02-13T05:50:18.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-13T05:50:18.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:50:18.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=9 2026-02-13T05:50:18.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:50:18.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/9 2026-02-13T05:50:18.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:50:18.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:50:18.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:50:18.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:50:18.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/9' 2026-02-13T05:50:18.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/9/journal' 2026-02-13T05:50:18.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:50:18.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:50:18.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:50:18.224 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:50:18.224 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:50:18.224 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:50:18.224 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:50:18.224 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:18.224 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:18.224 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:18.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:18.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:50:18.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:50:18.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:50:18.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:50:18.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:50:18.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:50:18.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:50:18.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:50:18.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:50:18.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:50:18.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:50:18.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/9 2026-02-13T05:50:18.225 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:50:18.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0884465c-2e4d-4aad-83f5-b36cc593a099 2026-02-13T05:50:18.226 INFO:tasks.workunit.client.0.trial024.stdout:add osd9 0884465c-2e4d-4aad-83f5-b36cc593a099 2026-02-13T05:50:18.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd9 0884465c-2e4d-4aad-83f5-b36cc593a099' 2026-02-13T05:50:18.227 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:50:18.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCau45prjkKDhAATVHIsCA/5C7jTEiYd9wlew== 2026-02-13T05:50:18.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCau45prjkKDhAATVHIsCA/5C7jTEiYd9wlew=="}' 2026-02-13T05:50:18.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0884465c-2e4d-4aad-83f5-b36cc593a099 -i td/test-erasure-code/9/new.json 2026-02-13T05:50:18.468 INFO:tasks.workunit.client.0.trial024.stdout:9 2026-02-13T05:50:18.476 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/9/new.json 2026-02-13T05:50:18.476 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 9 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/9 --osd-journal=td/test-erasure-code/9/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCau45prjkKDhAATVHIsCA/5C7jTEiYd9wlew== --osd-uuid 0884465c-2e4d-4aad-83f5-b36cc593a099 2026-02-13T05:50:18.494 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:18.493+0000 7f5337cfa900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:18.495 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:18.494+0000 7f5337cfa900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:18.496 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:18.495+0000 7f5337cfa900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:18.497 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:18.495+0000 7f5337cfa900 -1 bdev(0x5618762a2c00 td/test-erasure-code/9/block) open stat got: (1) Operation not permitted 2026-02-13T05:50:18.497 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:18.495+0000 7f5337cfa900 -1 bluestore(td/test-erasure-code/9) _read_fsid unparsable uuid 2026-02-13T05:50:18.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/9/keyring 2026-02-13T05:50:18.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:50:18.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd9 key to auth repository 2026-02-13T05:50:18.829 INFO:tasks.workunit.client.0.trial024.stdout:adding osd9 key to auth repository 2026-02-13T05:50:18.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/9/keyring auth add osd.9 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:50:19.138 INFO:tasks.workunit.client.0.trial024.stdout:start osd.9 2026-02-13T05:50:19.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.9 2026-02-13T05:50:19.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 9 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/9 --osd-journal=td/test-erasure-code/9/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:50:19.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:50:19.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:50:19.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:50:19.155 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:19.154+0000 7fe3e8a53900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:19.157 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:19.155+0000 7fe3e8a53900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:19.157 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:19.156+0000 7fe3e8a53900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:19.279 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:19.277+0000 7fe3e8a53900 -1 Falling back to public interface 2026-02-13T05:50:19.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 9 2026-02-13T05:50:19.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:50:19.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-13T05:50:19.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:50:19.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:50:19.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:19.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:50:19.373 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:50:19.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:19.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-13T05:50:19.598 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:19.596+0000 7fe3e8a53900 -1 osd.9 0 log_to_monitors true 2026-02-13T05:50:19.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:50:20.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:50:20.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:20.602 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:50:20.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:50:20.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:20.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-13T05:50:20.823 INFO:tasks.workunit.client.0.trial024.stdout:osd.9 up in weight 1 up_from 41 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6874/1031586581,v1:127.0.0.1:6875/1031586581] [v2:127.0.0.1:6876/1031586581,v1:127.0.0.1:6877/1031586581] exists,up 0884465c-2e4d-4aad-83f5-b36cc593a099 2026-02-13T05:50:20.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:20.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:20.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:20.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-13T05:50:20.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 10 2026-02-13T05:50:20.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-code 2026-02-13T05:50:20.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:50:20.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=10 2026-02-13T05:50:20.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:50:20.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-code/10 2026-02-13T05:50:20.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:50:20.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:50:20.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:50:20.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:50:20.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/10' 2026-02-13T05:50:20.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/10/journal' 2026-02-13T05:50:20.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:50:20.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:50:20.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:50:20.829 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:50:20.829 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:50:20.829 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:50:20.829 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:50:20.829 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:20.829 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:20.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:20.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:20.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:50:20.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:50:20.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:50:20.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:50:20.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:50:20.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:50:20.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:50:20.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:50:20.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:50:20.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:50:20.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:50:20.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-code/10 2026-02-13T05:50:20.831 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:50:20.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9d205f9f-c161-4cb2-89e5-1712122a9935 2026-02-13T05:50:20.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd10 9d205f9f-c161-4cb2-89e5-1712122a9935' 2026-02-13T05:50:20.832 INFO:tasks.workunit.client.0.trial024.stdout:add osd10 9d205f9f-c161-4cb2-89e5-1712122a9935 2026-02-13T05:50:20.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:50:20.839 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCcu45pky3/MRAAJkG5pVYd0C1Oj4hEUyGdyw== 2026-02-13T05:50:20.839 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCcu45pky3/MRAAJkG5pVYd0C1Oj4hEUyGdyw=="}' 2026-02-13T05:50:20.839 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9d205f9f-c161-4cb2-89e5-1712122a9935 -i td/test-erasure-code/10/new.json 2026-02-13T05:50:21.067 INFO:tasks.workunit.client.0.trial024.stdout:10 2026-02-13T05:50:21.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-code/10/new.json 2026-02-13T05:50:21.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 10 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/10 --osd-journal=td/test-erasure-code/10/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCcu45pky3/MRAAJkG5pVYd0C1Oj4hEUyGdyw== --osd-uuid 9d205f9f-c161-4cb2-89e5-1712122a9935 2026-02-13T05:50:21.095 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:21.095+0000 7fd35940d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:21.097 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:21.097+0000 7fd35940d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:21.098 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:21.098+0000 7fd35940d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:21.098 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:21.098+0000 7fd35940d900 -1 bdev(0x55ff37feac00 td/test-erasure-code/10/block) open stat got: (1) Operation not permitted 2026-02-13T05:50:21.098 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:21.098+0000 7fd35940d900 -1 bluestore(td/test-erasure-code/10) _read_fsid unparsable uuid 2026-02-13T05:50:21.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-code/10/keyring 2026-02-13T05:50:21.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:50:21.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd10 key to auth repository 2026-02-13T05:50:21.412 INFO:tasks.workunit.client.0.trial024.stdout:adding osd10 key to auth repository 2026-02-13T05:50:21.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-code/10/keyring auth add osd.10 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:50:21.755 INFO:tasks.workunit.client.0.trial024.stdout:start osd.10 2026-02-13T05:50:21.756 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.10 2026-02-13T05:50:21.757 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 10 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/10 --osd-journal=td/test-erasure-code/10/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:50:21.757 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:50:21.757 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:50:21.757 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:50:21.772 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:21.771+0000 7f603af25900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:21.773 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:21.773+0000 7f603af25900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:21.774 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:21.774+0000 7f603af25900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:21.947 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:21.947+0000 7f603af25900 -1 Falling back to public interface 2026-02-13T05:50:21.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 10 2026-02-13T05:50:21.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:50:21.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=10 2026-02-13T05:50:21.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:50:21.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:50:21.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:21.980 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:50:21.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:50:21.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:21.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2026-02-13T05:50:22.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:50:22.302 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:22.301+0000 7f603af25900 -1 osd.10 0 log_to_monitors true 2026-02-13T05:50:23.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:50:23.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:23.204 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:50:23.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:50:23.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:23.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2026-02-13T05:50:23.425 INFO:tasks.workunit.client.0.trial024.stdout:osd.10 up in weight 1 up_from 45 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6882/415144445,v1:127.0.0.1:6883/415144445] [v2:127.0.0.1:6884/415144445,v1:127.0.0.1:6885/415144445] exists,up 9d205f9f-c161-4cb2-89e5-1712122a9935 2026-02-13T05:50:23.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:23.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:23.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:23.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:39: run: create_rbd_pool 2026-02-13T05:50:23.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-13T05:50:23.640 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' does not exist 2026-02-13T05:50:23.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-13T05:50:23.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:50:23.874 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:50:23.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:50:24.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-13T05:50:25.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:40: run: wait_for_clean 2026-02-13T05:50:25.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:50:25.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:50:25.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:50:25.166 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:50:25.166 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:50:25.166 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:50:25.166 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:50:25.166 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:50:25.167 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:50:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:50:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:50:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:50:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:50:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:50:25.248 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:50:25.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:50:25.471 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:50:25.471 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:50:25.471 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:50:25.471 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:50:25.471 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:50:25.472 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:50:25.472 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:50:25.472 INFO:tasks.workunit.client.0.trial024.stderr:8 2026-02-13T05:50:25.472 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:50:25.472 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:50:25.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:50:25.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:25.472 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:50:25.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-13T05:50:25.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-13T05:50:25.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488' 2026-02-13T05:50:25.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:25.536 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:50:25.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705673 2026-02-13T05:50:25.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705673 2026-02-13T05:50:25.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673' 2026-02-13T05:50:25.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:25.600 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:50:25.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574855 2026-02-13T05:50:25.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574855 2026-02-13T05:50:25.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855' 2026-02-13T05:50:25.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:25.666 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:50:25.728 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444040 2026-02-13T05:50:25.728 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444040 2026-02-13T05:50:25.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040' 2026-02-13T05:50:25.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:25.729 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:50:25.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313222 2026-02-13T05:50:25.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313222 2026-02-13T05:50:25.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222' 2026-02-13T05:50:25.794 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:25.794 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:50:25.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182406 2026-02-13T05:50:25.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182406 2026-02-13T05:50:25.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222 5-107374182406' 2026-02-13T05:50:25.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:25.861 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:50:25.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051589 2026-02-13T05:50:25.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051589 2026-02-13T05:50:25.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222 5-107374182406 6-124554051589' 2026-02-13T05:50:25.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:25.925 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-13T05:50:25.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920773 2026-02-13T05:50:25.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920773 2026-02-13T05:50:25.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222 5-107374182406 6-124554051589 7-141733920773' 2026-02-13T05:50:25.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:25.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-13T05:50:26.053 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789957 2026-02-13T05:50:26.053 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789957 2026-02-13T05:50:26.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222 5-107374182406 6-124554051589 7-141733920773 8-158913789957' 2026-02-13T05:50:26.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:26.054 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-13T05:50:26.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659140 2026-02-13T05:50:26.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659140 2026-02-13T05:50:26.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222 5-107374182406 6-124554051589 7-141733920773 8-158913789957 9-176093659140' 2026-02-13T05:50:26.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:26.119 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-13T05:50:26.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528323 2026-02-13T05:50:26.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528323 2026-02-13T05:50:26.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705673 2-55834574855 3-73014444040 4-90194313222 5-107374182406 6-124554051589 7-141733920773 8-158913789957 9-176093659140 10-193273528323' 2026-02-13T05:50:26.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:26.185 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-13T05:50:26.185 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:26.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:50:26.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836488 2026-02-13T05:50:26.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:26.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836488 2026-02-13T05:50:26.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-13T05:50:26.188 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 21474836488 2026-02-13T05:50:26.188 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:50:26.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-13T05:50:26.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:26.411 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705673 2026-02-13T05:50:26.412 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:26.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:50:26.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705673 2026-02-13T05:50:26.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:26.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705673 2026-02-13T05:50:26.414 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 38654705673 2026-02-13T05:50:26.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-13T05:50:26.415 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:50:26.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705673 -lt 38654705673 2026-02-13T05:50:26.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:26.639 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574855 2026-02-13T05:50:26.640 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:26.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:50:26.641 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574855 2026-02-13T05:50:26.641 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:26.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574855 2026-02-13T05:50:26.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574855' 2026-02-13T05:50:26.643 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 55834574855 2026-02-13T05:50:26.643 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:50:26.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574853 -lt 55834574855 2026-02-13T05:50:26.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:50:27.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:50:27.867 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:50:28.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574856 -lt 55834574855 2026-02-13T05:50:28.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:28.095 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-73014444040 2026-02-13T05:50:28.095 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:28.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:50:28.097 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-73014444040 2026-02-13T05:50:28.097 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:28.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444040 2026-02-13T05:50:28.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 73014444040' 2026-02-13T05:50:28.098 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 73014444040 2026-02-13T05:50:28.098 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:50:28.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444040 -lt 73014444040 2026-02-13T05:50:28.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:28.322 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313222 2026-02-13T05:50:28.322 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:28.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:50:28.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313222 2026-02-13T05:50:28.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:28.325 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313222 2026-02-13T05:50:28.325 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313222' 2026-02-13T05:50:28.325 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 90194313222 2026-02-13T05:50:28.326 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:50:28.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313222 -lt 90194313222 2026-02-13T05:50:28.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:28.548 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-107374182406 2026-02-13T05:50:28.548 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:28.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:50:28.549 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-107374182406 2026-02-13T05:50:28.549 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:28.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182406 2026-02-13T05:50:28.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 107374182406' 2026-02-13T05:50:28.551 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 107374182406 2026-02-13T05:50:28.551 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:50:28.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182406 -lt 107374182406 2026-02-13T05:50:28.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:28.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-124554051589 2026-02-13T05:50:28.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:28.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:50:28.778 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-124554051589 2026-02-13T05:50:28.778 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:28.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=124554051589 2026-02-13T05:50:28.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 124554051589' 2026-02-13T05:50:28.779 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 124554051589 2026-02-13T05:50:28.780 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:50:29.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 124554051589 -lt 124554051589 2026-02-13T05:50:29.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:29.005 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920773 2026-02-13T05:50:29.005 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:29.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-13T05:50:29.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920773 2026-02-13T05:50:29.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:29.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920773 2026-02-13T05:50:29.007 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.7 seq 141733920773 2026-02-13T05:50:29.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920773' 2026-02-13T05:50:29.008 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-13T05:50:29.234 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920773 -lt 141733920773 2026-02-13T05:50:29.234 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:29.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789957 2026-02-13T05:50:29.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:29.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-13T05:50:29.236 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789957 2026-02-13T05:50:29.237 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:29.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789957 2026-02-13T05:50:29.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789957' 2026-02-13T05:50:29.238 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.8 seq 158913789957 2026-02-13T05:50:29.238 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-13T05:50:29.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789957 -lt 158913789957 2026-02-13T05:50:29.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:29.462 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-176093659140 2026-02-13T05:50:29.462 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:29.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-13T05:50:29.463 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-176093659140 2026-02-13T05:50:29.463 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:29.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=176093659140 2026-02-13T05:50:29.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 176093659140' 2026-02-13T05:50:29.465 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.9 seq 176093659140 2026-02-13T05:50:29.465 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-13T05:50:29.693 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 176093659140 -lt 176093659140 2026-02-13T05:50:29.693 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:29.694 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528323 2026-02-13T05:50:29.694 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:29.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-13T05:50:29.695 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528323 2026-02-13T05:50:29.696 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:29.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528323 2026-02-13T05:50:29.697 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.10 seq 193273528323 2026-02-13T05:50:29.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528323' 2026-02-13T05:50:29.698 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-13T05:50:29.921 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528324 -lt 193273528323 2026-02-13T05:50:29.922 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:50:29.922 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:50:29.922 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:50:30.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-13T05:50:30.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:50:30.232 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:50:30.233 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:50:30.233 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:50:30.233 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:50:30.233 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:50:30.233 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:50:30.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-13T05:50:30.454 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:50:30.455 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:50:30.455 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:50:30.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-13T05:50:30.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:50:30.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:50:30.765 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:42: run: get_asok_path osd.0 2026-02-13T05:50:30.765 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:50:30.765 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:50:30.765 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:50:30.765 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:30.765 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:30.765 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44477/ceph-osd.0.asok 2026-02-13T05:50:30.765 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:42: run: CEPH_ARGS= 2026-02-13T05:50:30.765 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:42: run: ceph --admin-daemon /tmp/ceph-asok.44477/ceph-osd.0.asok log flush 2026-02-13T05:50:30.813 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:50:30.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:43: run: grep 'load: jerasure.*lrc' td/test-erasure-code/osd.0.log 2026-02-13T05:50:30.819 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:49:56.534+0000 7f0b911f4900 0 load: jerasure load: lrc 2026-02-13T05:50:30.820 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:44: run: create_erasure_coded_pool ecpool 2026-02-13T05:50:30.820 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:56: create_erasure_coded_pool: local poolname=ecpool 2026-02-13T05:50:30.820 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:58: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd 2026-02-13T05:50:31.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:60: create_erasure_coded_pool: create_pool ecpool 12 12 erasure myprofile 2026-02-13T05:50:31.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 12 12 erasure myprofile 2026-02-13T05:50:31.474 INFO:tasks.workunit.client.0.trial024.stderr:pool 'ecpool' already exists 2026-02-13T05:50:31.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:50:32.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:62: create_erasure_coded_pool: wait_for_clean 2026-02-13T05:50:32.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:50:32.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:50:32.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:50:32.484 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:50:32.485 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:50:32.485 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:50:32.485 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:50:32.485 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:50:32.485 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:50:32.565 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:50:32.565 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:50:32.565 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:50:32.565 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:50:32.565 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:50:32.566 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:50:32.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:50:32.788 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:50:32.788 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:50:32.788 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:50:32.788 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:50:32.789 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:50:32.789 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:50:32.789 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:50:32.789 INFO:tasks.workunit.client.0.trial024.stderr:8 2026-02-13T05:50:32.789 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:50:32.789 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:50:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:50:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:32.789 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:50:32.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-13T05:50:32.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-13T05:50:32.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492' 2026-02-13T05:50:32.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:32.853 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:50:32.915 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705676 2026-02-13T05:50:32.915 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705676 2026-02-13T05:50:32.915 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676' 2026-02-13T05:50:32.915 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:32.915 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:50:32.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574859 2026-02-13T05:50:32.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574859 2026-02-13T05:50:32.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859' 2026-02-13T05:50:32.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:32.982 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:50:33.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444043 2026-02-13T05:50:33.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444043 2026-02-13T05:50:33.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043' 2026-02-13T05:50:33.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:33.046 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:50:33.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313226 2026-02-13T05:50:33.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313226 2026-02-13T05:50:33.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226' 2026-02-13T05:50:33.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:33.111 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:50:33.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182409 2026-02-13T05:50:33.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182409 2026-02-13T05:50:33.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226 5-107374182409' 2026-02-13T05:50:33.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:33.176 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:50:33.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051593 2026-02-13T05:50:33.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051593 2026-02-13T05:50:33.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226 5-107374182409 6-124554051593' 2026-02-13T05:50:33.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:33.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-13T05:50:33.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920776 2026-02-13T05:50:33.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920776 2026-02-13T05:50:33.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226 5-107374182409 6-124554051593 7-141733920776' 2026-02-13T05:50:33.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:33.304 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-13T05:50:33.366 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789961 2026-02-13T05:50:33.366 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789961 2026-02-13T05:50:33.366 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226 5-107374182409 6-124554051593 7-141733920776 8-158913789961' 2026-02-13T05:50:33.366 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:33.366 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-13T05:50:33.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659143 2026-02-13T05:50:33.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659143 2026-02-13T05:50:33.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226 5-107374182409 6-124554051593 7-141733920776 8-158913789961 9-176093659143' 2026-02-13T05:50:33.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:33.430 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-13T05:50:33.493 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528327 2026-02-13T05:50:33.493 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528327 2026-02-13T05:50:33.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859 3-73014444043 4-90194313226 5-107374182409 6-124554051593 7-141733920776 8-158913789961 9-176093659143 10-193273528327' 2026-02-13T05:50:33.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:33.494 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-13T05:50:33.494 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:33.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:50:33.496 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836492 2026-02-13T05:50:33.496 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:33.496 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836492 2026-02-13T05:50:33.497 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 21474836492 2026-02-13T05:50:33.497 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-13T05:50:33.497 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:50:33.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-13T05:50:33.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:33.720 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705676 2026-02-13T05:50:33.720 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:33.721 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:50:33.721 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705676 2026-02-13T05:50:33.722 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:33.723 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705676 2026-02-13T05:50:33.723 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 38654705676 2026-02-13T05:50:33.723 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705676' 2026-02-13T05:50:33.723 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:50:33.949 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705676 -lt 38654705676 2026-02-13T05:50:33.949 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:33.950 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574859 2026-02-13T05:50:33.950 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:33.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:50:33.951 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574859 2026-02-13T05:50:33.951 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:33.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574859 2026-02-13T05:50:33.952 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 55834574859 2026-02-13T05:50:33.953 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574859' 2026-02-13T05:50:33.953 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:50:34.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574859 -lt 55834574859 2026-02-13T05:50:34.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:34.179 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-73014444043 2026-02-13T05:50:34.180 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:34.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:50:34.181 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-73014444043 2026-02-13T05:50:34.181 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:34.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444043 2026-02-13T05:50:34.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 73014444043' 2026-02-13T05:50:34.183 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 73014444043 2026-02-13T05:50:34.183 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:50:34.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444043 -lt 73014444043 2026-02-13T05:50:34.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:34.414 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313226 2026-02-13T05:50:34.414 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:34.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:50:34.415 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313226 2026-02-13T05:50:34.415 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:34.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313226 2026-02-13T05:50:34.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313226' 2026-02-13T05:50:34.417 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 90194313226 2026-02-13T05:50:34.417 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:50:34.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313226 -lt 90194313226 2026-02-13T05:50:34.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:34.641 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-107374182409 2026-02-13T05:50:34.641 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:34.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:50:34.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-107374182409 2026-02-13T05:50:34.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:34.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182409 2026-02-13T05:50:34.644 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 107374182409 2026-02-13T05:50:34.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 107374182409' 2026-02-13T05:50:34.644 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:50:34.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182409 -lt 107374182409 2026-02-13T05:50:34.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:34.867 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-124554051593 2026-02-13T05:50:34.867 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:34.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:50:34.868 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-124554051593 2026-02-13T05:50:34.868 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:34.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=124554051593 2026-02-13T05:50:34.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 124554051593' 2026-02-13T05:50:34.870 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 124554051593 2026-02-13T05:50:34.870 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:50:35.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 124554051593 -lt 124554051593 2026-02-13T05:50:35.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:35.094 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920776 2026-02-13T05:50:35.094 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:35.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-13T05:50:35.096 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920776 2026-02-13T05:50:35.096 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:35.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920776 2026-02-13T05:50:35.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920776' 2026-02-13T05:50:35.097 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.7 seq 141733920776 2026-02-13T05:50:35.097 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-13T05:50:35.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920776 -lt 141733920776 2026-02-13T05:50:35.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:35.327 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789961 2026-02-13T05:50:35.327 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:35.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-13T05:50:35.328 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789961 2026-02-13T05:50:35.328 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:35.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789961 2026-02-13T05:50:35.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789961' 2026-02-13T05:50:35.329 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.8 seq 158913789961 2026-02-13T05:50:35.330 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-13T05:50:35.561 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789961 -lt 158913789961 2026-02-13T05:50:35.561 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:35.562 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-176093659143 2026-02-13T05:50:35.562 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:35.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-13T05:50:35.564 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-176093659143 2026-02-13T05:50:35.564 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:35.565 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=176093659143 2026-02-13T05:50:35.565 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 176093659143' 2026-02-13T05:50:35.565 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.9 seq 176093659143 2026-02-13T05:50:35.565 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-13T05:50:35.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 176093659143 -lt 176093659143 2026-02-13T05:50:35.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:35.789 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528327 2026-02-13T05:50:35.789 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:35.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-13T05:50:35.791 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528327 2026-02-13T05:50:35.791 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:35.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528327 2026-02-13T05:50:35.792 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.10 seq 193273528327 2026-02-13T05:50:35.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528327' 2026-02-13T05:50:35.793 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-13T05:50:36.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528327 -lt 193273528327 2026-02-13T05:50:36.016 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:50:36.016 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:50:36.017 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:50:36.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-13T05:50:36.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:50:36.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:50:36.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:50:36.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:50:36.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:50:36.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:50:36.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:50:36.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-13T05:50:36.543 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:50:36.544 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:50:36.544 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:50:36.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-13T05:50:36.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:50:36.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:50:36.865 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:46: run: set 2026-02-13T05:50:36.865 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:46: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T05:50:36.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:46: run: local 'funcs=TEST_alignment_constraints 2026-02-13T05:50:36.867 INFO:tasks.workunit.client.0.trial024.stderr:TEST_chunk_mapping 2026-02-13T05:50:36.867 INFO:tasks.workunit.client.0.trial024.stderr:TEST_rados_put_get_isa 2026-02-13T05:50:36.867 INFO:tasks.workunit.client.0.trial024.stderr:TEST_rados_put_get_jerasure 2026-02-13T05:50:36.868 INFO:tasks.workunit.client.0.trial024.stderr:TEST_rados_put_get_lrc_advanced 2026-02-13T05:50:36.868 INFO:tasks.workunit.client.0.trial024.stderr:TEST_rados_put_get_lrc_kml 2026-02-13T05:50:36.868 INFO:tasks.workunit.client.0.trial024.stderr:TEST_rados_put_get_shec' 2026-02-13T05:50:36.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-13T05:50:36.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_alignment_constraints td/test-erasure-code 2026-02-13T05:50:36.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:253: TEST_alignment_constraints: local payload=ABC 2026-02-13T05:50:36.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:254: TEST_alignment_constraints: echo ABC 2026-02-13T05:50:36.868 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:260: TEST_alignment_constraints: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-13T05:50:36.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:260: TEST_alignment_constraints: local stripe_unit=4096 2026-02-13T05:50:36.879 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:261: TEST_alignment_constraints: ceph osd erasure-code-profile get myprofile 2026-02-13T05:50:36.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:261: TEST_alignment_constraints: grep k= 2026-02-13T05:50:37.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:261: TEST_alignment_constraints: eval local k=2 2026-02-13T05:50:37.110 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:261: TEST_alignment_constraints: local k=2 2026-02-13T05:50:37.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:262: TEST_alignment_constraints: local block_size=8191 2026-02-13T05:50:37.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:263: TEST_alignment_constraints: dd if=/dev/zero of=td/test-erasure-code/ORIGINAL bs=8191 count=2 2026-02-13T05:50:37.111 INFO:tasks.workunit.client.0.trial024.stderr:2+0 records in 2026-02-13T05:50:37.111 INFO:tasks.workunit.client.0.trial024.stderr:2+0 records out 2026-02-13T05:50:37.111 INFO:tasks.workunit.client.0.trial024.stderr:16382 bytes (16 kB, 16 KiB) copied, 6.7746e-05 s, 242 MB/s 2026-02-13T05:50:37.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:264: TEST_alignment_constraints: rados --block-size=8191 --pool ecpool put UNALIGNED td/test-erasure-code/ORIGINAL 2026-02-13T05:50:37.127 INFO:tasks.workunit.client.0.trial024.stderr:INFO: op_size has been rounded to 8192 2026-02-13T05:50:37.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:266: TEST_alignment_constraints: rm td/test-erasure-code/ORIGINAL 2026-02-13T05:50:37.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-13T05:50:37.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_chunk_mapping td/test-erasure-code 2026-02-13T05:50:37.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:304: TEST_chunk_mapping: local dir=td/test-erasure-code 2026-02-13T05:50:37.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:311: TEST_chunk_mapping: verify_chunk_mapping td/test-erasure-code ecpool 0 1 2026-02-13T05:50:37.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:281: verify_chunk_mapping: local dir=td/test-erasure-code 2026-02-13T05:50:37.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:282: verify_chunk_mapping: local poolname=ecpool 2026-02-13T05:50:37.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:283: verify_chunk_mapping: local first=0 2026-02-13T05:50:37.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:284: verify_chunk_mapping: local second=1 2026-02-13T05:50:37.133 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: chunk_size 2026-02-13T05:50:37.134 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-13T05:50:37.143 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: echo 4096 2026-02-13T05:50:37.143 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: printf '%*s' 4096 FIRSTecpool 2026-02-13T05:50:37.144 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: chunk_size 2026-02-13T05:50:37.144 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-13T05:50:37.154 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: echo 4096 2026-02-13T05:50:37.155 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: printf '%*s' 4096 SECONDecpool 2026-02-13T05:50:37.155 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: local 'payload= FIRSTecpool SECONDecpool' 2026-02-13T05:50:37.156 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:287: verify_chunk_mapping: echo -n ' FIRSTecpool SECONDecpool' 2026-02-13T05:50:37.156 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:289: verify_chunk_mapping: rados --pool ecpool put SOMETHINGecpool td/test-erasure-code/ORIGINAL 2026-02-13T05:50:37.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:290: verify_chunk_mapping: rados --pool ecpool get SOMETHINGecpool td/test-erasure-code/COPY 2026-02-13T05:50:37.196 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: get_osds ecpool SOMETHINGecpool 2026-02-13T05:50:37.196 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-13T05:50:37.196 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHINGecpool 2026-02-13T05:50:37.196 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHINGecpool 2026-02-13T05:50:37.197 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:50:37.420 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:50:37.421 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:50:37.421 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:50:37.421 INFO:tasks.workunit.client.0.trial024.stderr:0' 2026-02-13T05:50:37.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 9 0 2026-02-13T05:50:37.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: osds=('3' '5' '9' '0') 2026-02-13T05:50:37.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: local -a osds 2026-02-13T05:50:37.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i = 0 )) 2026-02-13T05:50:37.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-13T05:50:37.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.3 flush_journal 2026-02-13T05:50:37.479 INFO:tasks.workunit.client.0.trial024.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-13T05:50:37.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-13T05:50:37.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-13T05:50:37.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.5 flush_journal 2026-02-13T05:50:37.537 INFO:tasks.workunit.client.0.trial024.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-13T05:50:37.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-13T05:50:37.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-13T05:50:37.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.9 flush_journal 2026-02-13T05:50:37.595 INFO:tasks.workunit.client.0.trial024.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-13T05:50:37.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-13T05:50:37.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-13T05:50:37.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.0 flush_journal 2026-02-13T05:50:37.654 INFO:tasks.workunit.client.0.trial024.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-13T05:50:37.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-13T05:50:37.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-13T05:50:37.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:295: verify_chunk_mapping: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:50:37.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:296: verify_chunk_mapping: rm td/test-erasure-code/COPY 2026-02-13T05:50:37.658 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: get_osds ecpool SOMETHINGecpool 2026-02-13T05:50:37.658 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-13T05:50:37.658 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHINGecpool 2026-02-13T05:50:37.659 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHINGecpool 2026-02-13T05:50:37.659 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:50:37.882 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:50:37.882 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:50:37.882 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:50:37.882 INFO:tasks.workunit.client.0.trial024.stderr:0' 2026-02-13T05:50:37.882 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 9 0 2026-02-13T05:50:37.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: osds=('3' '5' '9' '0') 2026-02-13T05:50:37.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: local -a osds 2026-02-13T05:50:37.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:299: verify_chunk_mapping: objectstore_tool td/test-erasure-code 3 SOMETHINGecpool get-bytes 2026-02-13T05:50:37.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:299: verify_chunk_mapping: grep --quiet FIRSTecpool 2026-02-13T05:50:37.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-code 2026-02-13T05:50:37.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:50:37.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-13T05:50:37.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:50:37.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-code 3 SOMETHINGecpool get-bytes 2026-02-13T05:50:37.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-code 2026-02-13T05:50:37.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:50:37.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-13T05:50:37.884 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:50:37.884 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-code TERM osd.3 2026-02-13T05:50:37.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:50:37.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:50:37.884 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:50:37.884 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:50:37.884 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:50:38.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:50:38.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-code 3 SOMETHINGecpool get-bytes 2026-02-13T05:50:38.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-code 2026-02-13T05:50:38.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:50:38.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-13T05:50:38.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:50:38.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-code/3 2026-02-13T05:50:38.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-code/3 SOMETHINGecpool get-bytes 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-code 3 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-code 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-code/3 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-code/3' 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-code/3/journal' 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:50:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-code/3 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:start osd.3 2026-02-13T05:50:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/3 --osd-journal=td/test-erasure-code/3/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:50:38.299 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-code/3/whoami 2026-02-13T05:50:38.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-13T05:50:38.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:50:38.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:50:38.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:50:38.312 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:38.312+0000 7f6352701900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:38.313 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:38.313+0000 7f6352701900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:38.314 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:38.314+0000 7f6352701900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:38.460 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:38.458+0000 7f6352701900 -1 Falling back to public interface 2026-02-13T05:50:38.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-13T05:50:38.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:50:38.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:50:38.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:50:38.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:50:38.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:38.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:50:38.524 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:50:38.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:38.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:50:38.746 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:50:38.775 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:38.774+0000 7f6352701900 -1 osd.3 63 log_to_monitors true 2026-02-13T05:50:39.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:50:39.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:39.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:50:39.748 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:50:39.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:39.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:50:39.972 INFO:tasks.workunit.client.0.trial024.stderr:osd.3 up in weight 1 up_from 67 up_thru 67 down_at 64 last_clean_interval [17,63) [v2:127.0.0.1:6826/2721471301,v1:127.0.0.1:6827/2721471301] [v2:127.0.0.1:6828/2721471301,v1:127.0.0.1:6829/2721471301] exists,up 5ed6723b-8f74-452c-9720-fbde4eabaa42 2026-02-13T05:50:39.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:39.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:39.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:39.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:50:39.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:50:39.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:50:39.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:50:39.973 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:50:39.973 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:50:39.974 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:50:39.974 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:50:39.974 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:50:39.974 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:50:40.053 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:50:40.053 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:50:40.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:50:40.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:50:40.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:50:40.054 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:50:40.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:50:40.276 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:50:40.276 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:50:40.276 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:50:40.276 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:50:40.276 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:50:40.276 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:50:40.276 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:50:40.276 INFO:tasks.workunit.client.0.trial024.stderr:8 2026-02-13T05:50:40.277 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:50:40.277 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:50:40.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:50:40.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:40.277 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:50:40.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836495 2026-02-13T05:50:40.339 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836495 2026-02-13T05:50:40.339 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495' 2026-02-13T05:50:40.339 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:40.339 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:50:40.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705680 2026-02-13T05:50:40.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705680 2026-02-13T05:50:40.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680' 2026-02-13T05:50:40.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:40.403 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:50:40.466 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574862 2026-02-13T05:50:40.467 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574862 2026-02-13T05:50:40.467 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862' 2026-02-13T05:50:40.467 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:40.467 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:50:40.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808835 2026-02-13T05:50:40.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808835 2026-02-13T05:50:40.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835' 2026-02-13T05:50:40.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:40.531 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:50:40.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313229 2026-02-13T05:50:40.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313229 2026-02-13T05:50:40.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229' 2026-02-13T05:50:40.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:40.595 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:50:40.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182413 2026-02-13T05:50:40.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182413 2026-02-13T05:50:40.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229 5-107374182413' 2026-02-13T05:50:40.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:40.662 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:50:40.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051596 2026-02-13T05:50:40.727 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051596 2026-02-13T05:50:40.727 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229 5-107374182413 6-124554051596' 2026-02-13T05:50:40.727 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:40.727 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-13T05:50:40.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920780 2026-02-13T05:50:40.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920780 2026-02-13T05:50:40.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229 5-107374182413 6-124554051596 7-141733920780' 2026-02-13T05:50:40.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:40.790 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-13T05:50:40.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789964 2026-02-13T05:50:40.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789964 2026-02-13T05:50:40.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229 5-107374182413 6-124554051596 7-141733920780 8-158913789964' 2026-02-13T05:50:40.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:40.854 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-13T05:50:40.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659147 2026-02-13T05:50:40.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659147 2026-02-13T05:50:40.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229 5-107374182413 6-124554051596 7-141733920780 8-158913789964 9-176093659147' 2026-02-13T05:50:40.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:40.919 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-13T05:50:40.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528330 2026-02-13T05:50:40.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528330 2026-02-13T05:50:40.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836495 1-38654705680 2-55834574862 3-287762808835 4-90194313229 5-107374182413 6-124554051596 7-141733920780 8-158913789964 9-176093659147 10-193273528330' 2026-02-13T05:50:40.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:40.983 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836495 2026-02-13T05:50:40.983 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:40.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:50:40.984 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836495 2026-02-13T05:50:40.984 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:40.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836495 2026-02-13T05:50:40.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2026-02-13T05:50:40.985 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 21474836495 2026-02-13T05:50:40.985 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:50:41.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836493 -lt 21474836495 2026-02-13T05:50:41.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:50:42.211 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:50:42.211 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:50:42.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836495 -lt 21474836495 2026-02-13T05:50:42.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:42.436 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705680 2026-02-13T05:50:42.436 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:42.436 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:50:42.437 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705680 2026-02-13T05:50:42.437 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:42.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705680 2026-02-13T05:50:42.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705680' 2026-02-13T05:50:42.438 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 38654705680 2026-02-13T05:50:42.438 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:50:42.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705680 -lt 38654705680 2026-02-13T05:50:42.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:42.664 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574862 2026-02-13T05:50:42.664 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:42.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:50:42.665 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574862 2026-02-13T05:50:42.665 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:42.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574862 2026-02-13T05:50:42.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574862' 2026-02-13T05:50:42.666 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 55834574862 2026-02-13T05:50:42.667 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:50:42.890 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574862 -lt 55834574862 2026-02-13T05:50:42.890 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:42.891 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808835 2026-02-13T05:50:42.891 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:42.891 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:50:42.892 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808835 2026-02-13T05:50:42.892 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:42.893 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808835 2026-02-13T05:50:42.893 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808835' 2026-02-13T05:50:42.893 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 287762808835 2026-02-13T05:50:42.894 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:50:43.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808835 -lt 287762808835 2026-02-13T05:50:43.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:43.117 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313229 2026-02-13T05:50:43.117 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:43.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:50:43.118 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313229 2026-02-13T05:50:43.118 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:43.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313229 2026-02-13T05:50:43.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313229' 2026-02-13T05:50:43.119 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.4 seq 90194313229 2026-02-13T05:50:43.119 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:50:43.343 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313229 -lt 90194313229 2026-02-13T05:50:43.343 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:43.344 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-107374182413 2026-02-13T05:50:43.344 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:43.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:50:43.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-107374182413 2026-02-13T05:50:43.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:43.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182413 2026-02-13T05:50:43.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 107374182413' 2026-02-13T05:50:43.346 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.5 seq 107374182413 2026-02-13T05:50:43.347 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:50:43.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182413 -lt 107374182413 2026-02-13T05:50:43.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:43.569 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-124554051596 2026-02-13T05:50:43.569 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:43.570 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:50:43.571 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-124554051596 2026-02-13T05:50:43.571 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:43.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=124554051596 2026-02-13T05:50:43.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 124554051596' 2026-02-13T05:50:43.572 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.6 seq 124554051596 2026-02-13T05:50:43.572 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:50:43.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 124554051597 -lt 124554051596 2026-02-13T05:50:43.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:43.797 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920780 2026-02-13T05:50:43.797 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:43.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-13T05:50:43.798 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920780 2026-02-13T05:50:43.798 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:43.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920780 2026-02-13T05:50:43.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920780' 2026-02-13T05:50:43.799 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.7 seq 141733920780 2026-02-13T05:50:43.800 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-13T05:50:44.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920780 -lt 141733920780 2026-02-13T05:50:44.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:44.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789964 2026-02-13T05:50:44.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:44.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-13T05:50:44.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789964 2026-02-13T05:50:44.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:44.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789964 2026-02-13T05:50:44.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789964' 2026-02-13T05:50:44.027 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.8 seq 158913789964 2026-02-13T05:50:44.028 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-13T05:50:44.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789965 -lt 158913789964 2026-02-13T05:50:44.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:44.251 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-176093659147 2026-02-13T05:50:44.251 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:44.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-13T05:50:44.252 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-176093659147 2026-02-13T05:50:44.252 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:44.253 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=176093659147 2026-02-13T05:50:44.253 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 176093659147' 2026-02-13T05:50:44.253 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.9 seq 176093659147 2026-02-13T05:50:44.253 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-13T05:50:44.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 176093659147 -lt 176093659147 2026-02-13T05:50:44.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:44.484 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528330 2026-02-13T05:50:44.484 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:44.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-13T05:50:44.485 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528330 2026-02-13T05:50:44.485 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:44.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528330 2026-02-13T05:50:44.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528330' 2026-02-13T05:50:44.487 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.10 seq 193273528330 2026-02-13T05:50:44.487 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-13T05:50:44.713 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528331 -lt 193273528330 2026-02-13T05:50:44.714 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:50:44.714 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:50:44.714 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:50:45.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-13T05:50:45.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:50:45.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:50:45.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:50:45.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:50:45.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:50:45.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:50:45.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:50:45.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-13T05:50:45.247 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:50:45.247 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:50:45.248 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:50:45.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-13T05:50:45.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:50:45.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:50:45.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:300: verify_chunk_mapping: objectstore_tool td/test-erasure-code 5 SOMETHINGecpool get-bytes 2026-02-13T05:50:45.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-code 2026-02-13T05:50:45.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:50:45.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-13T05:50:45.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:50:45.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-code 5 SOMETHINGecpool get-bytes 2026-02-13T05:50:45.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-code 2026-02-13T05:50:45.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:50:45.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-13T05:50:45.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:50:45.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-code TERM osd.5 2026-02-13T05:50:45.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:300: verify_chunk_mapping: grep --quiet SECONDecpool 2026-02-13T05:50:45.558 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:50:45.558 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:50:45.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:50:45.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:50:45.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:50:45.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:50:45.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-code 5 SOMETHINGecpool get-bytes 2026-02-13T05:50:45.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-code 2026-02-13T05:50:45.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:50:45.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-13T05:50:45.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:50:45.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-code/5 2026-02-13T05:50:45.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-code/5 SOMETHINGecpool get-bytes 2026-02-13T05:50:45.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-code 5 2026-02-13T05:50:45.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-code 2026-02-13T05:50:45.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:50:45.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-13T05:50:45.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:50:45.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-code/5 2026-02-13T05:50:45.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:50:45.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:50:45.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:50:45.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:50:45.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-code/5' 2026-02-13T05:50:45.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-code/5/journal' 2026-02-13T05:50:45.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:50:45.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:50:45.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:50:45.769 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:50:45.769 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:50:45.769 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:50:45.770 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:50:45.770 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:45.770 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:45.770 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:45.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:45.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:50:45.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:50:45.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:50:45.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:50:45.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:50:45.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:50:45.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:50:45.771 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:50:45.771 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:50:45.771 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-code/5 2026-02-13T05:50:45.771 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-13T05:50:45.771 INFO:tasks.workunit.client.0.trial024.stderr:start osd.5 2026-02-13T05:50:45.771 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/5 --osd-journal=td/test-erasure-code/5/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:50:45.771 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-code/5/whoami 2026-02-13T05:50:45.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-13T05:50:45.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:50:45.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:50:45.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:50:45.783 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:45.782+0000 7f22856d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:45.784 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:45.783+0000 7f22856d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:45.785 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:45.784+0000 7f22856d7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:45.920 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:45.918+0000 7f22856d7900 -1 Falling back to public interface 2026-02-13T05:50:45.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-13T05:50:45.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:50:45.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-13T05:50:45.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:50:45.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:50:45.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:45.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:50:45.992 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:50:45.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:45.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:50:46.216 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:50:46.268 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:46.266+0000 7f22856d7900 -1 osd.5 69 log_to_monitors true 2026-02-13T05:50:47.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:50:47.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:47.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:50:47.218 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:50:47.219 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:47.219 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:50:47.452 INFO:tasks.workunit.client.0.trial024.stderr:osd.5 up in weight 1 up_from 72 up_thru 72 down_at 69 last_clean_interval [25,69) [v2:127.0.0.1:6842/534553755,v1:127.0.0.1:6843/534553755] [v2:127.0.0.1:6844/534553755,v1:127.0.0.1:6845/534553755] exists,up f6b8e3d8-c145-4442-947d-df83693722b6 2026-02-13T05:50:47.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:47.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:47.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:47.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:50:47.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:50:47.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:50:47.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:50:47.453 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:50:47.453 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:50:47.453 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:50:47.454 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:50:47.454 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:50:47.454 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:50:47.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:50:47.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:50:47.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:50:47.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:50:47.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:50:47.532 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:50:47.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:50:47.754 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:50:47.754 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:50:47.754 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:50:47.754 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:50:47.754 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:50:47.755 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:50:47.755 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:50:47.755 INFO:tasks.workunit.client.0.trial024.stderr:8 2026-02-13T05:50:47.755 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:50:47.755 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:50:47.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:50:47.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:47.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:50:47.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836499 2026-02-13T05:50:47.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836499 2026-02-13T05:50:47.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499' 2026-02-13T05:50:47.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:47.818 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:50:47.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705683 2026-02-13T05:50:47.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705683 2026-02-13T05:50:47.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683' 2026-02-13T05:50:47.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:47.882 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:50:47.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574866 2026-02-13T05:50:47.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574866 2026-02-13T05:50:47.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866' 2026-02-13T05:50:47.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:47.946 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:50:48.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808838 2026-02-13T05:50:48.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808838 2026-02-13T05:50:48.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838' 2026-02-13T05:50:48.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:48.011 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:50:48.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313233 2026-02-13T05:50:48.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313233 2026-02-13T05:50:48.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233' 2026-02-13T05:50:48.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:48.075 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:50:48.141 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645315 2026-02-13T05:50:48.142 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645315 2026-02-13T05:50:48.142 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233 5-309237645315' 2026-02-13T05:50:48.142 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:48.142 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:50:48.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051600 2026-02-13T05:50:48.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051600 2026-02-13T05:50:48.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233 5-309237645315 6-124554051600' 2026-02-13T05:50:48.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:48.206 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-13T05:50:48.268 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920783 2026-02-13T05:50:48.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920783 2026-02-13T05:50:48.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233 5-309237645315 6-124554051600 7-141733920783' 2026-02-13T05:50:48.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:48.269 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-13T05:50:48.334 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789968 2026-02-13T05:50:48.334 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789968 2026-02-13T05:50:48.334 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233 5-309237645315 6-124554051600 7-141733920783 8-158913789968' 2026-02-13T05:50:48.334 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:48.334 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-13T05:50:48.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659150 2026-02-13T05:50:48.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659150 2026-02-13T05:50:48.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233 5-309237645315 6-124554051600 7-141733920783 8-158913789968 9-176093659150' 2026-02-13T05:50:48.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:48.397 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-13T05:50:48.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528333 2026-02-13T05:50:48.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528333 2026-02-13T05:50:48.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-287762808838 4-90194313233 5-309237645315 6-124554051600 7-141733920783 8-158913789968 9-176093659150 10-193273528333' 2026-02-13T05:50:48.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:48.463 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836499 2026-02-13T05:50:48.463 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:48.463 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:50:48.464 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836499 2026-02-13T05:50:48.464 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:48.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836499 2026-02-13T05:50:48.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836499' 2026-02-13T05:50:48.465 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 21474836499 2026-02-13T05:50:48.466 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:50:48.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836496 -lt 21474836499 2026-02-13T05:50:48.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:50:49.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:50:49.690 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:50:49.916 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836499 -lt 21474836499 2026-02-13T05:50:49.916 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:49.916 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705683 2026-02-13T05:50:49.916 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:49.917 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:50:49.917 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705683 2026-02-13T05:50:49.918 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:49.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705683 2026-02-13T05:50:49.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705683' 2026-02-13T05:50:49.919 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 38654705683 2026-02-13T05:50:49.919 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:50:50.144 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705683 -lt 38654705683 2026-02-13T05:50:50.144 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:50.144 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574866 2026-02-13T05:50:50.144 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:50.145 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:50:50.145 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574866 2026-02-13T05:50:50.145 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:50.146 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574866 2026-02-13T05:50:50.146 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574866' 2026-02-13T05:50:50.146 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 55834574866 2026-02-13T05:50:50.147 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:50:50.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574866 -lt 55834574866 2026-02-13T05:50:50.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:50.370 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808838 2026-02-13T05:50:50.370 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:50.370 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:50:50.371 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808838 2026-02-13T05:50:50.371 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:50.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808838 2026-02-13T05:50:50.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808838' 2026-02-13T05:50:50.372 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 287762808838 2026-02-13T05:50:50.372 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:50:50.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808839 -lt 287762808838 2026-02-13T05:50:50.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:50.598 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313233 2026-02-13T05:50:50.598 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:50.598 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:50:50.599 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313233 2026-02-13T05:50:50.599 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:50.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313233 2026-02-13T05:50:50.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313233' 2026-02-13T05:50:50.600 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.4 seq 90194313233 2026-02-13T05:50:50.601 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:50:50.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313233 -lt 90194313233 2026-02-13T05:50:50.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:50.826 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-309237645315 2026-02-13T05:50:50.826 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:50.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:50:50.827 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-309237645315 2026-02-13T05:50:50.827 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:50.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645315 2026-02-13T05:50:50.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 309237645315' 2026-02-13T05:50:50.828 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.5 seq 309237645315 2026-02-13T05:50:50.828 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:50:51.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645315 -lt 309237645315 2026-02-13T05:50:51.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:51.055 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-124554051600 2026-02-13T05:50:51.055 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:51.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:50:51.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-124554051600 2026-02-13T05:50:51.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:51.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=124554051600 2026-02-13T05:50:51.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 124554051600' 2026-02-13T05:50:51.058 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.6 seq 124554051600 2026-02-13T05:50:51.058 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:50:51.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 124554051600 -lt 124554051600 2026-02-13T05:50:51.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:51.283 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920783 2026-02-13T05:50:51.283 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:51.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-13T05:50:51.284 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920783 2026-02-13T05:50:51.284 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:51.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920783 2026-02-13T05:50:51.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920783' 2026-02-13T05:50:51.286 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.7 seq 141733920783 2026-02-13T05:50:51.286 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-13T05:50:51.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920783 -lt 141733920783 2026-02-13T05:50:51.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:51.514 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789968 2026-02-13T05:50:51.514 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:51.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-13T05:50:51.515 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789968 2026-02-13T05:50:51.516 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:51.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789968 2026-02-13T05:50:51.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789968' 2026-02-13T05:50:51.517 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.8 seq 158913789968 2026-02-13T05:50:51.517 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-13T05:50:51.742 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789968 -lt 158913789968 2026-02-13T05:50:51.742 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:51.742 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-176093659150 2026-02-13T05:50:51.743 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:51.743 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-13T05:50:51.744 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-176093659150 2026-02-13T05:50:51.744 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:51.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=176093659150 2026-02-13T05:50:51.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 176093659150' 2026-02-13T05:50:51.745 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.9 seq 176093659150 2026-02-13T05:50:51.745 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-13T05:50:51.967 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 176093659151 -lt 176093659150 2026-02-13T05:50:51.967 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:51.967 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528333 2026-02-13T05:50:51.968 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:51.969 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-13T05:50:51.969 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528333 2026-02-13T05:50:51.970 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:51.971 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528333 2026-02-13T05:50:51.971 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528333' 2026-02-13T05:50:51.971 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.10 seq 193273528333 2026-02-13T05:50:51.971 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-13T05:50:52.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528334 -lt 193273528333 2026-02-13T05:50:52.197 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:50:52.197 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:50:52.197 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:50:52.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-13T05:50:52.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:50:52.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:50:52.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:50:52.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:50:52.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:50:52.524 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:50:52.524 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:50:52.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-13T05:50:52.745 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:50:52.746 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:50:52.746 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:50:53.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-13T05:50:53.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:50:53.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:50:53.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:313: TEST_chunk_mapping: ceph osd erasure-code-profile set remap-profile plugin=lrc 'layers=[ [ "cDD", "" ] ]' mapping=_DD 'crush-steps=[ [ "choose", "osd", 0 ] ]' 2026-02-13T05:50:53.352 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:318: TEST_chunk_mapping: ceph osd erasure-code-profile get remap-profile 2026-02-13T05:50:53.575 INFO:tasks.workunit.client.0.trial024.stdout:crush-device-class= 2026-02-13T05:50:53.575 INFO:tasks.workunit.client.0.trial024.stdout:crush-failure-domain=host 2026-02-13T05:50:53.575 INFO:tasks.workunit.client.0.trial024.stdout:crush-num-failure-domains=0 2026-02-13T05:50:53.575 INFO:tasks.workunit.client.0.trial024.stdout:crush-osds-per-failure-domain=0 2026-02-13T05:50:53.576 INFO:tasks.workunit.client.0.trial024.stdout:crush-root=default 2026-02-13T05:50:53.576 INFO:tasks.workunit.client.0.trial024.stdout:crush-steps=[ [ "choose", "osd", 0 ] ] 2026-02-13T05:50:53.576 INFO:tasks.workunit.client.0.trial024.stdout:k=-1 2026-02-13T05:50:53.576 INFO:tasks.workunit.client.0.trial024.stdout:l=-1 2026-02-13T05:50:53.576 INFO:tasks.workunit.client.0.trial024.stdout:layers=[ [ "cDD", "" ] ] 2026-02-13T05:50:53.576 INFO:tasks.workunit.client.0.trial024.stdout:m=-1 2026-02-13T05:50:53.576 INFO:tasks.workunit.client.0.trial024.stdout:mapping=_DD 2026-02-13T05:50:53.576 INFO:tasks.workunit.client.0.trial024.stdout:plugin=lrc 2026-02-13T05:50:53.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:319: TEST_chunk_mapping: create_pool remap-pool 12 12 erasure remap-profile 2026-02-13T05:50:53.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create remap-pool 12 12 erasure remap-profile 2026-02-13T05:50:53.928 INFO:tasks.workunit.client.0.trial024.stderr:pool 'remap-pool' already exists 2026-02-13T05:50:53.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:50:54.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:327: TEST_chunk_mapping: verify_chunk_mapping td/test-erasure-code remap-pool 1 2 2026-02-13T05:50:54.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:281: verify_chunk_mapping: local dir=td/test-erasure-code 2026-02-13T05:50:54.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:282: verify_chunk_mapping: local poolname=remap-pool 2026-02-13T05:50:54.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:283: verify_chunk_mapping: local first=1 2026-02-13T05:50:54.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:284: verify_chunk_mapping: local second=2 2026-02-13T05:50:54.939 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: chunk_size 2026-02-13T05:50:54.939 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-13T05:50:54.950 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: echo 4096 2026-02-13T05:50:54.950 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: printf '%*s' 4096 FIRSTremap-pool 2026-02-13T05:50:54.951 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: chunk_size 2026-02-13T05:50:54.951 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-13T05:50:54.962 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: echo 4096 2026-02-13T05:50:54.962 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: printf '%*s' 4096 SECONDremap-pool 2026-02-13T05:50:54.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: local 'payload= FIRSTremap-pool SECONDremap-pool' 2026-02-13T05:50:54.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:287: verify_chunk_mapping: echo -n ' FIRSTremap-pool SECONDremap-pool' 2026-02-13T05:50:54.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:289: verify_chunk_mapping: rados --pool remap-pool put SOMETHINGremap-pool td/test-erasure-code/ORIGINAL 2026-02-13T05:50:54.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:290: verify_chunk_mapping: rados --pool remap-pool get SOMETHINGremap-pool td/test-erasure-code/COPY 2026-02-13T05:50:55.001 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: get_osds remap-pool SOMETHINGremap-pool 2026-02-13T05:50:55.001 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=remap-pool 2026-02-13T05:50:55.001 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHINGremap-pool 2026-02-13T05:50:55.002 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map remap-pool SOMETHINGremap-pool 2026-02-13T05:50:55.002 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:50:55.228 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=4 2026-02-13T05:50:55.228 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:50:55.228 INFO:tasks.workunit.client.0.trial024.stderr:9' 2026-02-13T05:50:55.228 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 4 6 9 2026-02-13T05:50:55.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: osds=('4' '6' '9') 2026-02-13T05:50:55.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: local -a osds 2026-02-13T05:50:55.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i = 0 )) 2026-02-13T05:50:55.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 3 )) 2026-02-13T05:50:55.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.4 flush_journal 2026-02-13T05:50:55.287 INFO:tasks.workunit.client.0.trial024.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-13T05:50:55.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-13T05:50:55.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 3 )) 2026-02-13T05:50:55.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.6 flush_journal 2026-02-13T05:50:55.345 INFO:tasks.workunit.client.0.trial024.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-13T05:50:55.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-13T05:50:55.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 3 )) 2026-02-13T05:50:55.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.9 flush_journal 2026-02-13T05:50:55.401 INFO:tasks.workunit.client.0.trial024.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-13T05:50:55.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-13T05:50:55.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 3 )) 2026-02-13T05:50:55.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:295: verify_chunk_mapping: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:50:55.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:296: verify_chunk_mapping: rm td/test-erasure-code/COPY 2026-02-13T05:50:55.405 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: get_osds remap-pool SOMETHINGremap-pool 2026-02-13T05:50:55.405 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=remap-pool 2026-02-13T05:50:55.405 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHINGremap-pool 2026-02-13T05:50:55.406 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map remap-pool SOMETHINGremap-pool 2026-02-13T05:50:55.406 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:50:55.632 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=4 2026-02-13T05:50:55.632 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:50:55.633 INFO:tasks.workunit.client.0.trial024.stderr:9' 2026-02-13T05:50:55.633 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 4 6 9 2026-02-13T05:50:55.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: osds=('4' '6' '9') 2026-02-13T05:50:55.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: local -a osds 2026-02-13T05:50:55.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:299: verify_chunk_mapping: objectstore_tool td/test-erasure-code 6 SOMETHINGremap-pool get-bytes 2026-02-13T05:50:55.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:299: verify_chunk_mapping: grep --quiet FIRSTremap-pool 2026-02-13T05:50:55.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-code 2026-02-13T05:50:55.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:50:55.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=6 2026-02-13T05:50:55.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:50:55.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-code 6 SOMETHINGremap-pool get-bytes 2026-02-13T05:50:55.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-code 2026-02-13T05:50:55.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:50:55.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=6 2026-02-13T05:50:55.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:50:55.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-code TERM osd.6 2026-02-13T05:50:55.634 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:50:55.634 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:50:55.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:50:55.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:50:55.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:50:55.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:50:55.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-code 6 SOMETHINGremap-pool get-bytes 2026-02-13T05:50:55.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-code 2026-02-13T05:50:55.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:50:55.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=6 2026-02-13T05:50:55.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:50:55.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-code/6 2026-02-13T05:50:55.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-code/6 SOMETHINGremap-pool get-bytes 2026-02-13T05:50:56.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-code 6 2026-02-13T05:50:56.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-code 2026-02-13T05:50:56.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:50:56.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=6 2026-02-13T05:50:56.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:50:56.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-code/6 2026-02-13T05:50:56.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:50:56.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:50:56.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:50:56.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:50:56.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-code/6' 2026-02-13T05:50:56.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-code/6/journal' 2026-02-13T05:50:56.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:50:56.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:50:56.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:50:56.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:50:56.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:50:56.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:50:56.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:50:56.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:50:56.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-code/6 2026-02-13T05:50:56.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.6 2026-02-13T05:50:56.039 INFO:tasks.workunit.client.0.trial024.stderr:start osd.6 2026-02-13T05:50:56.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 6 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/6 --osd-journal=td/test-erasure-code/6/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:50:56.039 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-code/6/whoami 2026-02-13T05:50:56.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 6 = 6 ']' 2026-02-13T05:50:56.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:50:56.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:50:56.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:50:56.051 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:56.051+0000 7fe5aec19900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:56.052 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:56.052+0000 7fe5aec19900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:56.053 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:56.053+0000 7fe5aec19900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:50:56.190 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:56.189+0000 7fe5aec19900 -1 Falling back to public interface 2026-02-13T05:50:56.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 6 2026-02-13T05:50:56.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:50:56.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-13T05:50:56.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:50:56.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:50:56.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:56.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:50:56.264 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:50:56.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:56.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:50:56.493 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:50:56.521 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:50:56.521+0000 7fe5aec19900 -1 osd.6 87 log_to_monitors true 2026-02-13T05:50:57.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:50:57.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:50:57.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:50:57.495 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:50:57.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:50:57.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:50:57.718 INFO:tasks.workunit.client.0.trial024.stderr:osd.6 up in weight 1 up_from 91 up_thru 91 down_at 88 last_clean_interval [29,87) [v2:127.0.0.1:6850/4098884603,v1:127.0.0.1:6851/4098884603] [v2:127.0.0.1:6852/4098884603,v1:127.0.0.1:6853/4098884603] exists,up 854efcac-ea28-41df-9bfc-0e57b118f2ff 2026-02-13T05:50:57.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:50:57.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:50:57.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:50:57.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:50:57.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:50:57.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:50:57.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:50:57.719 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:50:57.719 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:50:57.719 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:50:57.719 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:50:57.719 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:50:57.719 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:50:57.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:50:57.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:50:57.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:50:57.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:50:57.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:50:57.798 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:50:58.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:50:58.025 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:50:58.025 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:50:58.025 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:50:58.025 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:50:58.025 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:50:58.025 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:50:58.025 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:50:58.025 INFO:tasks.workunit.client.0.trial024.stderr:8 2026-02-13T05:50:58.026 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:50:58.026 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:50:58.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:50:58.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:58.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:50:58.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836503 2026-02-13T05:50:58.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836503 2026-02-13T05:50:58.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503' 2026-02-13T05:50:58.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:58.091 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:50:58.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705687 2026-02-13T05:50:58.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705687 2026-02-13T05:50:58.155 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687' 2026-02-13T05:50:58.155 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:58.155 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:50:58.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574870 2026-02-13T05:50:58.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574870 2026-02-13T05:50:58.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870' 2026-02-13T05:50:58.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:58.218 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:50:58.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808842 2026-02-13T05:50:58.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808842 2026-02-13T05:50:58.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842' 2026-02-13T05:50:58.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:58.282 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:50:58.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313237 2026-02-13T05:50:58.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313237 2026-02-13T05:50:58.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237' 2026-02-13T05:50:58.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:58.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:50:58.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645319 2026-02-13T05:50:58.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645319 2026-02-13T05:50:58.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237 5-309237645319' 2026-02-13T05:50:58.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:58.408 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:50:58.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=390842023939 2026-02-13T05:50:58.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 390842023939 2026-02-13T05:50:58.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237 5-309237645319 6-390842023939' 2026-02-13T05:50:58.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:58.472 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-13T05:50:58.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920787 2026-02-13T05:50:58.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920787 2026-02-13T05:50:58.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237 5-309237645319 6-390842023939 7-141733920787' 2026-02-13T05:50:58.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:58.537 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-13T05:50:58.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789972 2026-02-13T05:50:58.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789972 2026-02-13T05:50:58.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237 5-309237645319 6-390842023939 7-141733920787 8-158913789972' 2026-02-13T05:50:58.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:58.603 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-13T05:50:58.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659154 2026-02-13T05:50:58.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659154 2026-02-13T05:50:58.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237 5-309237645319 6-390842023939 7-141733920787 8-158913789972 9-176093659154' 2026-02-13T05:50:58.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:50:58.666 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-13T05:50:58.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528338 2026-02-13T05:50:58.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528338 2026-02-13T05:50:58.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-55834574870 3-287762808842 4-90194313237 5-309237645319 6-390842023939 7-141733920787 8-158913789972 9-176093659154 10-193273528338' 2026-02-13T05:50:58.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:50:58.732 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836503 2026-02-13T05:50:58.732 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:50:58.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:50:58.733 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836503 2026-02-13T05:50:58.733 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:50:58.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836503 2026-02-13T05:50:58.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836503' 2026-02-13T05:50:58.734 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 21474836503 2026-02-13T05:50:58.734 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:50:58.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836500 -lt 21474836503 2026-02-13T05:50:58.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:50:59.958 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:50:59.959 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:51:00.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836503 -lt 21474836503 2026-02-13T05:51:00.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:00.185 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705687 2026-02-13T05:51:00.185 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:00.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:51:00.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705687 2026-02-13T05:51:00.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:00.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705687 2026-02-13T05:51:00.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705687' 2026-02-13T05:51:00.187 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 38654705687 2026-02-13T05:51:00.187 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:51:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705687 -lt 38654705687 2026-02-13T05:51:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:00.412 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574870 2026-02-13T05:51:00.412 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:00.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:51:00.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574870 2026-02-13T05:51:00.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:00.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574870 2026-02-13T05:51:00.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574870' 2026-02-13T05:51:00.414 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 55834574870 2026-02-13T05:51:00.415 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:51:00.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574870 -lt 55834574870 2026-02-13T05:51:00.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:00.641 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808842 2026-02-13T05:51:00.641 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:00.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:51:00.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808842 2026-02-13T05:51:00.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:00.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808842 2026-02-13T05:51:00.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808842' 2026-02-13T05:51:00.643 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 287762808842 2026-02-13T05:51:00.643 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:51:00.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808843 -lt 287762808842 2026-02-13T05:51:00.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:00.864 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313237 2026-02-13T05:51:00.865 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:00.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:51:00.865 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313237 2026-02-13T05:51:00.866 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:00.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313237 2026-02-13T05:51:00.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313237' 2026-02-13T05:51:00.867 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.4 seq 90194313237 2026-02-13T05:51:00.867 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:51:01.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313237 -lt 90194313237 2026-02-13T05:51:01.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:01.090 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-309237645319 2026-02-13T05:51:01.091 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:01.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:51:01.092 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-309237645319 2026-02-13T05:51:01.092 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:01.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645319 2026-02-13T05:51:01.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 309237645319' 2026-02-13T05:51:01.093 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.5 seq 309237645319 2026-02-13T05:51:01.093 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:51:01.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645319 -lt 309237645319 2026-02-13T05:51:01.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:01.318 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-390842023939 2026-02-13T05:51:01.319 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:01.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:51:01.320 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-390842023939 2026-02-13T05:51:01.320 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:01.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=390842023939 2026-02-13T05:51:01.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 390842023939' 2026-02-13T05:51:01.321 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.6 seq 390842023939 2026-02-13T05:51:01.321 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:51:01.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 390842023939 -lt 390842023939 2026-02-13T05:51:01.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:01.544 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920787 2026-02-13T05:51:01.544 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:01.544 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-13T05:51:01.545 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920787 2026-02-13T05:51:01.545 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:01.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920787 2026-02-13T05:51:01.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920787' 2026-02-13T05:51:01.546 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.7 seq 141733920787 2026-02-13T05:51:01.546 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-13T05:51:01.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920788 -lt 141733920787 2026-02-13T05:51:01.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:01.772 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789972 2026-02-13T05:51:01.772 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:01.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-13T05:51:01.774 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789972 2026-02-13T05:51:01.774 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:01.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789972 2026-02-13T05:51:01.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789972' 2026-02-13T05:51:01.775 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.8 seq 158913789972 2026-02-13T05:51:01.775 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-13T05:51:01.997 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789972 -lt 158913789972 2026-02-13T05:51:01.998 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:01.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-176093659154 2026-02-13T05:51:01.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:01.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-13T05:51:01.999 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-176093659154 2026-02-13T05:51:01.999 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:02.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=176093659154 2026-02-13T05:51:02.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 176093659154' 2026-02-13T05:51:02.001 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.9 seq 176093659154 2026-02-13T05:51:02.001 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-13T05:51:02.229 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 176093659155 -lt 176093659154 2026-02-13T05:51:02.229 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:02.230 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528338 2026-02-13T05:51:02.230 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:02.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-13T05:51:02.231 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528338 2026-02-13T05:51:02.231 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:02.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528338 2026-02-13T05:51:02.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528338' 2026-02-13T05:51:02.232 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.10 seq 193273528338 2026-02-13T05:51:02.232 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-13T05:51:02.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528338 -lt 193273528338 2026-02-13T05:51:02.454 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:51:02.455 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:51:02.455 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:51:02.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 28 == 0 2026-02-13T05:51:02.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:51:02.770 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:51:02.770 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:51:02.770 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:51:02.770 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:51:02.770 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:51:02.770 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:51:03.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=28 2026-02-13T05:51:03.000 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:51:03.000 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:51:03.001 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:51:03.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 = 28 2026-02-13T05:51:03.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:51:03.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:300: verify_chunk_mapping: objectstore_tool td/test-erasure-code 9 SOMETHINGremap-pool get-bytes 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-code 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-code 9 SOMETHINGremap-pool get-bytes 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:300: verify_chunk_mapping: grep --quiet SECONDremap-pool 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-code 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-code TERM osd.9 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:51:03.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:51:03.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:51:03.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-code 9 SOMETHINGremap-pool get-bytes 2026-02-13T05:51:03.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-code 2026-02-13T05:51:03.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:51:03.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-13T05:51:03.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:51:03.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-code/9 2026-02-13T05:51:03.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-code/9 SOMETHINGremap-pool get-bytes 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-code 9 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-code 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-code/9 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-code/9' 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-code/9/journal' 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:51:03.512 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:51:03.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-code/9 2026-02-13T05:51:03.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-13T05:51:03.514 INFO:tasks.workunit.client.0.trial024.stderr:start osd.9 2026-02-13T05:51:03.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=58b3bfa3-89b8-48a5-bbf1-3d38e90e1d9a --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/9 --osd-journal=td/test-erasure-code/9/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.44477/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:51:03.514 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-code/9/whoami 2026-02-13T05:51:03.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-13T05:51:03.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:51:03.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:51:03.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:51:03.528 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:51:03.528+0000 7fc4af12d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:51:03.529 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:51:03.529+0000 7fc4af12d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:51:03.530 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:51:03.530+0000 7fc4af12d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:51:03.714 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:51:03.714+0000 7fc4af12d900 -1 Falling back to public interface 2026-02-13T05:51:03.743 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-13T05:51:03.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:51:03.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-13T05:51:03.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:51:03.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:51:03.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:51:03.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:51:03.744 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:51:03.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:51:03.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-13T05:51:03.968 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:51:04.113 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:51:04.113+0000 7fc4af12d900 -1 osd.9 93 log_to_monitors true 2026-02-13T05:51:04.969 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:51:04.969 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:51:04.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:51:04.970 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:51:04.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:51:04.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-13T05:51:05.191 INFO:tasks.workunit.client.0.trial024.stderr:osd.9 up in weight 1 up_from 96 up_thru 96 down_at 93 last_clean_interval [41,93) [v2:127.0.0.1:6874/2407511528,v1:127.0.0.1:6875/2407511528] [v2:127.0.0.1:6876/2407511528,v1:127.0.0.1:6877/2407511528] exists,up 0884465c-2e4d-4aad-83f5-b36cc593a099 2026-02-13T05:51:05.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:51:05.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:51:05.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:51:05.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:51:05.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:51:05.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:51:05.191 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:51:05.191 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:51:05.192 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:51:05.192 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:51:05.192 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:51:05.192 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:51:05.192 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:51:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:51:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:51:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:51:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:51:05.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:51:05.272 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:51:05.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:51:05.494 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:51:05.494 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:51:05.494 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:51:05.494 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:51:05.495 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:51:05.495 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:51:05.495 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:51:05.495 INFO:tasks.workunit.client.0.trial024.stderr:8 2026-02-13T05:51:05.495 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:51:05.495 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:51:05.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:51:05.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:05.495 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:51:05.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836506 2026-02-13T05:51:05.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836506 2026-02-13T05:51:05.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506' 2026-02-13T05:51:05.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:05.557 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:51:05.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705691 2026-02-13T05:51:05.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705691 2026-02-13T05:51:05.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691' 2026-02-13T05:51:05.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:05.624 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:51:05.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574873 2026-02-13T05:51:05.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574873 2026-02-13T05:51:05.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873' 2026-02-13T05:51:05.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:05.689 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:51:05.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808846 2026-02-13T05:51:05.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808846 2026-02-13T05:51:05.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846' 2026-02-13T05:51:05.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:05.753 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:51:05.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313240 2026-02-13T05:51:05.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313240 2026-02-13T05:51:05.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240' 2026-02-13T05:51:05.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:05.819 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:51:05.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645322 2026-02-13T05:51:05.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645322 2026-02-13T05:51:05.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240 5-309237645322' 2026-02-13T05:51:05.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:05.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:51:05.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=390842023942 2026-02-13T05:51:05.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 390842023942 2026-02-13T05:51:05.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240 5-309237645322 6-390842023942' 2026-02-13T05:51:05.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:05.947 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-13T05:51:06.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920791 2026-02-13T05:51:06.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920791 2026-02-13T05:51:06.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240 5-309237645322 6-390842023942 7-141733920791' 2026-02-13T05:51:06.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:06.011 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-13T05:51:06.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789975 2026-02-13T05:51:06.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789975 2026-02-13T05:51:06.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240 5-309237645322 6-390842023942 7-141733920791 8-158913789975' 2026-02-13T05:51:06.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:06.076 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-13T05:51:06.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=412316860419 2026-02-13T05:51:06.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 412316860419 2026-02-13T05:51:06.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240 5-309237645322 6-390842023942 7-141733920791 8-158913789975 9-412316860419' 2026-02-13T05:51:06.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:06.140 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-13T05:51:06.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528341 2026-02-13T05:51:06.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528341 2026-02-13T05:51:06.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836506 1-38654705691 2-55834574873 3-287762808846 4-90194313240 5-309237645322 6-390842023942 7-141733920791 8-158913789975 9-412316860419 10-193273528341' 2026-02-13T05:51:06.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:06.205 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836506 2026-02-13T05:51:06.205 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:06.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:51:06.206 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836506 2026-02-13T05:51:06.206 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:06.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836506 2026-02-13T05:51:06.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2026-02-13T05:51:06.208 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 21474836506 2026-02-13T05:51:06.208 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:51:06.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836506 -lt 21474836506 2026-02-13T05:51:06.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:06.433 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705691 2026-02-13T05:51:06.433 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:06.434 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:51:06.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705691 2026-02-13T05:51:06.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:06.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705691 2026-02-13T05:51:06.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705691' 2026-02-13T05:51:06.435 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 38654705691 2026-02-13T05:51:06.436 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:51:06.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705691 -lt 38654705691 2026-02-13T05:51:06.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:06.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574873 2026-02-13T05:51:06.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:06.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:51:06.661 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574873 2026-02-13T05:51:06.662 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:06.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574873 2026-02-13T05:51:06.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574873' 2026-02-13T05:51:06.663 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 55834574873 2026-02-13T05:51:06.663 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:51:06.886 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574871 -lt 55834574873 2026-02-13T05:51:06.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:51:07.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:51:07.888 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:51:08.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574874 -lt 55834574873 2026-02-13T05:51:08.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:08.109 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808846 2026-02-13T05:51:08.110 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:08.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:51:08.111 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808846 2026-02-13T05:51:08.111 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:08.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808846 2026-02-13T05:51:08.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808846' 2026-02-13T05:51:08.112 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 287762808846 2026-02-13T05:51:08.112 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:51:08.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808846 -lt 287762808846 2026-02-13T05:51:08.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:08.335 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313240 2026-02-13T05:51:08.335 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:08.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:51:08.337 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313240 2026-02-13T05:51:08.337 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:08.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313240 2026-02-13T05:51:08.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313240' 2026-02-13T05:51:08.338 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.4 seq 90194313240 2026-02-13T05:51:08.339 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:51:08.561 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313240 -lt 90194313240 2026-02-13T05:51:08.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:08.562 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-309237645322 2026-02-13T05:51:08.562 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:08.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:51:08.563 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-309237645322 2026-02-13T05:51:08.563 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:08.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645322 2026-02-13T05:51:08.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 309237645322' 2026-02-13T05:51:08.565 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.5 seq 309237645322 2026-02-13T05:51:08.565 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:51:08.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645323 -lt 309237645322 2026-02-13T05:51:08.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:08.787 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-390842023942 2026-02-13T05:51:08.787 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:08.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:51:08.788 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-390842023942 2026-02-13T05:51:08.788 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:08.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=390842023942 2026-02-13T05:51:08.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 390842023942' 2026-02-13T05:51:08.789 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.6 seq 390842023942 2026-02-13T05:51:08.789 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:51:09.020 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 390842023943 -lt 390842023942 2026-02-13T05:51:09.020 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:09.021 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920791 2026-02-13T05:51:09.021 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:09.021 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-13T05:51:09.022 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920791 2026-02-13T05:51:09.022 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:09.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920791 2026-02-13T05:51:09.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920791' 2026-02-13T05:51:09.023 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.7 seq 141733920791 2026-02-13T05:51:09.023 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-13T05:51:09.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920791 -lt 141733920791 2026-02-13T05:51:09.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:09.247 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789975 2026-02-13T05:51:09.247 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:09.248 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-13T05:51:09.248 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789975 2026-02-13T05:51:09.249 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:09.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789975 2026-02-13T05:51:09.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789975' 2026-02-13T05:51:09.250 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.8 seq 158913789975 2026-02-13T05:51:09.250 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-13T05:51:09.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789975 -lt 158913789975 2026-02-13T05:51:09.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:09.478 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-412316860419 2026-02-13T05:51:09.478 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:09.478 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-13T05:51:09.479 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-412316860419 2026-02-13T05:51:09.479 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:09.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=412316860419 2026-02-13T05:51:09.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 412316860419' 2026-02-13T05:51:09.480 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.9 seq 412316860419 2026-02-13T05:51:09.480 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-13T05:51:09.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 412316860420 -lt 412316860419 2026-02-13T05:51:09.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:09.712 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528341 2026-02-13T05:51:09.712 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:09.713 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-13T05:51:09.713 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528341 2026-02-13T05:51:09.713 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:09.714 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528341 2026-02-13T05:51:09.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528341' 2026-02-13T05:51:09.715 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.10 seq 193273528341 2026-02-13T05:51:09.715 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-13T05:51:09.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528342 -lt 193273528341 2026-02-13T05:51:09.937 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:51:09.937 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:51:09.937 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:51:10.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 28 == 0 2026-02-13T05:51:10.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:51:10.251 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:51:10.251 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:51:10.251 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:51:10.251 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:51:10.251 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:51:10.251 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:51:10.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=28 2026-02-13T05:51:10.475 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:51:10.475 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:51:10.475 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:51:10.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 = 28 2026-02-13T05:51:10.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:51:10.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:51:10.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:329: TEST_chunk_mapping: delete_pool remap-pool 2026-02-13T05:51:10.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=remap-pool 2026-02-13T05:51:10.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete remap-pool remap-pool --yes-i-really-really-mean-it 2026-02-13T05:51:11.024 INFO:tasks.workunit.client.0.trial024.stderr:pool 'remap-pool' does not exist 2026-02-13T05:51:11.033 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:330: TEST_chunk_mapping: ceph osd erasure-code-profile rm remap-profile 2026-02-13T05:51:11.311 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile remap-profile does not exist 2026-02-13T05:51:11.320 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-13T05:51:11.320 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_isa td/test-erasure-code 2026-02-13T05:51:11.320 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:193: TEST_rados_put_get_isa: erasure_code_plugin_exists isa 2026-02-13T05:51:11.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2104: erasure_code_plugin_exists: local plugin=isa 2026-02-13T05:51:11.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2105: erasure_code_plugin_exists: local status 2026-02-13T05:51:11.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2106: erasure_code_plugin_exists: local grepstr 2026-02-13T05:51:11.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2107: erasure_code_plugin_exists: local s 2026-02-13T05:51:11.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2108: erasure_code_plugin_exists: case `uname` in 2026-02-13T05:51:11.321 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2108: erasure_code_plugin_exists: uname 2026-02-13T05:51:11.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2110: erasure_code_plugin_exists: grepstr='isa.*No such file' 2026-02-13T05:51:11.322 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2113: erasure_code_plugin_exists: ceph osd erasure-code-profile set TESTPROFILE plugin=isa 2026-02-13T05:51:11.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2113: erasure_code_plugin_exists: s= 2026-02-13T05:51:11.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2114: erasure_code_plugin_exists: local status=0 2026-02-13T05:51:11.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2115: erasure_code_plugin_exists: '[' 0 -eq 0 ']' 2026-02-13T05:51:11.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2116: erasure_code_plugin_exists: ceph osd erasure-code-profile rm TESTPROFILE 2026-02-13T05:51:11.878 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile TESTPROFILE does not exist 2026-02-13T05:51:11.886 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2125: erasure_code_plugin_exists: return 0 2026-02-13T05:51:11.886 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:197: TEST_rados_put_get_isa: local dir=td/test-erasure-code 2026-02-13T05:51:11.886 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:198: TEST_rados_put_get_isa: local poolname=pool-isa 2026-02-13T05:51:11.886 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:200: TEST_rados_put_get_isa: ceph osd erasure-code-profile set profile-isa plugin=isa crush-failure-domain=osd 2026-02-13T05:51:12.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:203: TEST_rados_put_get_isa: create_pool pool-isa 1 1 erasure profile-isa 2026-02-13T05:51:12.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-isa 1 1 erasure profile-isa 2026-02-13T05:51:12.538 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-isa' already exists 2026-02-13T05:51:12.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:51:13.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:206: TEST_rados_put_get_isa: rados_put_get td/test-erasure-code pool-isa 2026-02-13T05:51:13.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-13T05:51:13.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-isa 2026-02-13T05:51:13.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-13T05:51:13.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:13.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-13T05:51:13.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:13.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-13T05:51:13.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:13.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-13T05:51:13.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:13.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-13T05:51:13.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-isa put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-13T05:51:13.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-isa get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:51:13.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:51:13.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-13T05:51:13.589 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-isa SOMETHING 2026-02-13T05:51:13.589 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-isa 2026-02-13T05:51:13.589 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:51:13.590 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-isa SOMETHING 2026-02-13T05:51:13.590 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:51:13.814 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=4 2026-02-13T05:51:13.815 INFO:tasks.workunit.client.0.trial024.stderr:10 2026-02-13T05:51:13.815 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:51:13.815 INFO:tasks.workunit.client.0.trial024.stderr:7' 2026-02-13T05:51:13.815 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 4 10 0 7 2026-02-13T05:51:13.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('4' '10' '0' '7') 2026-02-13T05:51:13.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-13T05:51:13.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=3 2026-02-13T05:51:13.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 7 2026-02-13T05:51:14.046 INFO:tasks.workunit.client.0.trial024.stderr:osd.7 is already out. 2026-02-13T05:51:14.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-13T05:51:19.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-isa SOMETHING 2026-02-13T05:51:19.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-isa 2026-02-13T05:51:19.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:51:19.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<7\>' 2026-02-13T05:51:19.059 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-isa SOMETHING 2026-02-13T05:51:19.059 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:51:19.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=4 2026-02-13T05:51:19.284 INFO:tasks.workunit.client.0.trial024.stderr:10 2026-02-13T05:51:19.284 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:51:19.284 INFO:tasks.workunit.client.0.trial024.stderr:1' 2026-02-13T05:51:19.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 4 10 0 1 2026-02-13T05:51:19.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-isa get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:51:19.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:51:19.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 7 2026-02-13T05:51:19.533 INFO:tasks.workunit.client.0.trial024.stderr:osd.7 is already in. 2026-02-13T05:51:19.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-13T05:51:19.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:208: TEST_rados_put_get_isa: delete_pool pool-isa 2026-02-13T05:51:19.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=pool-isa 2026-02-13T05:51:19.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete pool-isa pool-isa --yes-i-really-really-mean-it 2026-02-13T05:51:19.836 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-isa' does not exist 2026-02-13T05:51:19.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-13T05:51:19.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_jerasure td/test-erasure-code 2026-02-13T05:51:19.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:212: TEST_rados_put_get_jerasure: local dir=td/test-erasure-code 2026-02-13T05:51:19.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:214: TEST_rados_put_get_jerasure: rados_put_get td/test-erasure-code ecpool 2026-02-13T05:51:19.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-13T05:51:19.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=ecpool 2026-02-13T05:51:19.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-13T05:51:19.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:19.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-13T05:51:19.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:19.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-13T05:51:19.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:19.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-13T05:51:19.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:19.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-13T05:51:19.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool ecpool put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-13T05:51:19.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool ecpool get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:51:19.884 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:51:19.885 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-13T05:51:19.886 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds ecpool SOMETHING 2026-02-13T05:51:19.887 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-13T05:51:19.887 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:51:19.887 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:51:19.887 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-13T05:51:20.116 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=6 2026-02-13T05:51:20.116 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:51:20.116 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:51:20.116 INFO:tasks.workunit.client.0.trial024.stderr:9' 2026-02-13T05:51:20.116 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 6 0 7 9 2026-02-13T05:51:20.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('6' '0' '7' '9') 2026-02-13T05:51:20.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-13T05:51:20.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=3 2026-02-13T05:51:20.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 9 2026-02-13T05:51:20.365 INFO:tasks.workunit.client.0.trial024.stderr:osd.9 is already out. 2026-02-13T05:51:20.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-13T05:51:25.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds ecpool SOMETHING 2026-02-13T05:51:25.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-13T05:51:25.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:51:25.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<9\>' 2026-02-13T05:51:25.377 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-13T05:51:25.377 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:51:25.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=6 2026-02-13T05:51:25.612 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:51:25.612 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:51:25.612 INFO:tasks.workunit.client.0.trial024.stderr:5' 2026-02-13T05:51:25.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 6 0 7 5 2026-02-13T05:51:25.613 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool ecpool get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:51:25.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:51:25.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 9 2026-02-13T05:51:25.860 INFO:tasks.workunit.client.0.trial024.stderr:osd.9 is already in. 2026-02-13T05:51:25.869 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-13T05:51:25.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:216: TEST_rados_put_get_jerasure: local poolname=pool-jerasure 2026-02-13T05:51:25.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:217: TEST_rados_put_get_jerasure: local profile=profile-jerasure 2026-02-13T05:51:25.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:219: TEST_rados_put_get_jerasure: ceph osd erasure-code-profile set profile-jerasure plugin=jerasure k=4 m=2 crush-failure-domain=osd 2026-02-13T05:51:26.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:223: TEST_rados_put_get_jerasure: create_pool pool-jerasure 12 12 erasure profile-jerasure 2026-02-13T05:51:26.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 12 12 erasure profile-jerasure 2026-02-13T05:51:26.541 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T05:51:26.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:51:27.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:226: TEST_rados_put_get_jerasure: rados_put_get td/test-erasure-code pool-jerasure 2026-02-13T05:51:27.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-13T05:51:27.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-jerasure 2026-02-13T05:51:27.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-13T05:51:27.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:27.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-13T05:51:27.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:27.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-13T05:51:27.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:27.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-13T05:51:27.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:27.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-13T05:51:27.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-jerasure put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-13T05:51:27.575 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-jerasure get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:51:27.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:51:27.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-13T05:51:27.598 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-jerasure SOMETHING 2026-02-13T05:51:27.598 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:51:27.598 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:51:27.598 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-13T05:51:27.599 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:51:27.827 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=5 2026-02-13T05:51:27.827 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:51:27.827 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:51:27.827 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:51:27.827 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:51:27.827 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:51:27.828 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 5 1 9 4 3 10 2026-02-13T05:51:27.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('5' '1' '9' '4' '3' '10') 2026-02-13T05:51:27.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-13T05:51:27.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=5 2026-02-13T05:51:27.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 10 2026-02-13T05:51:28.103 INFO:tasks.workunit.client.0.trial024.stderr:osd.10 is already out. 2026-02-13T05:51:28.113 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-13T05:51:33.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-jerasure SOMETHING 2026-02-13T05:51:33.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:51:33.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<10\>' 2026-02-13T05:51:33.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:51:33.115 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-13T05:51:33.115 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:51:33.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=5 2026-02-13T05:51:33.344 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:51:33.344 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:51:33.344 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:51:33.344 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:51:33.344 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:51:33.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 5 1 9 4 3 6 2026-02-13T05:51:33.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-jerasure get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:51:33.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:51:33.365 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 10 2026-02-13T05:51:33.647 INFO:tasks.workunit.client.0.trial024.stderr:osd.10 is already in. 2026-02-13T05:51:33.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:227: TEST_rados_put_get_jerasure: rados_osds_out_in td/test-erasure-code pool-jerasure 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:104: rados_osds_out_in: local dir=td/test-erasure-code 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:105: rados_osds_out_in: local poolname=pool-jerasure 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:106: rados_osds_out_in: local objname=SOMETHING 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:109: rados_osds_out_in: for marker in FFFF GGGG HHHH IIII 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:110: rados_osds_out_in: printf '%*s' 1024 FFFF 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:109: rados_osds_out_in: for marker in FFFF GGGG HHHH IIII 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:110: rados_osds_out_in: printf '%*s' 1024 GGGG 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:109: rados_osds_out_in: for marker in FFFF GGGG HHHH IIII 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:110: rados_osds_out_in: printf '%*s' 1024 HHHH 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:109: rados_osds_out_in: for marker in FFFF GGGG HHHH IIII 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:110: rados_osds_out_in: printf '%*s' 1024 IIII 2026-02-13T05:51:33.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:116: rados_osds_out_in: rados --pool pool-jerasure put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-13T05:51:33.724 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:117: rados_osds_out_in: rados --pool pool-jerasure get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:51:33.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:118: rados_osds_out_in: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:51:33.746 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:119: rados_osds_out_in: rm td/test-erasure-code/COPY 2026-02-13T05:51:33.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:127: rados_osds_out_in: wait_for_clean 2026-02-13T05:51:33.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:51:33.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:51:33.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:51:33.747 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:51:33.748 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:51:33.748 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:51:33.748 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:51:33.748 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:51:33.749 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:51:33.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:51:33.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:51:33.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:51:33.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:51:33.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:51:33.828 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:51:34.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:51:34.053 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:51:34.053 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:51:34.053 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:51:34.053 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:51:34.053 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:51:34.053 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:51:34.054 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:51:34.054 INFO:tasks.workunit.client.0.trial024.stderr:8 2026-02-13T05:51:34.054 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:51:34.054 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:51:34.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:51:34.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:34.054 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:51:34.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836514 2026-02-13T05:51:34.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836514 2026-02-13T05:51:34.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514' 2026-02-13T05:51:34.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:34.112 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:51:34.178 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705698 2026-02-13T05:51:34.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705698 2026-02-13T05:51:34.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698' 2026-02-13T05:51:34.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:34.179 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:51:34.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574881 2026-02-13T05:51:34.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574881 2026-02-13T05:51:34.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881' 2026-02-13T05:51:34.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:34.242 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:51:34.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808854 2026-02-13T05:51:34.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808854 2026-02-13T05:51:34.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808854' 2026-02-13T05:51:34.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:34.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:51:34.370 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313248 2026-02-13T05:51:34.370 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313248 2026-02-13T05:51:34.370 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808854 4-90194313248' 2026-02-13T05:51:34.371 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:34.371 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:51:34.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645330 2026-02-13T05:51:34.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645330 2026-02-13T05:51:34.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808854 4-90194313248 5-309237645330' 2026-02-13T05:51:34.436 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:34.436 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:51:34.499 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=390842023950 2026-02-13T05:51:34.499 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 390842023950 2026-02-13T05:51:34.499 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808854 4-90194313248 5-309237645330 6-390842023950' 2026-02-13T05:51:34.499 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:34.499 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-13T05:51:34.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920798 2026-02-13T05:51:34.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920798 2026-02-13T05:51:34.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808854 4-90194313248 5-309237645330 6-390842023950 7-141733920798' 2026-02-13T05:51:34.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:34.563 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-13T05:51:34.625 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789983 2026-02-13T05:51:34.625 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789983 2026-02-13T05:51:34.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808854 4-90194313248 5-309237645330 6-390842023950 7-141733920798 8-158913789983' 2026-02-13T05:51:34.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:34.626 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-13T05:51:34.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=412316860427 2026-02-13T05:51:34.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 412316860427 2026-02-13T05:51:34.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808854 4-90194313248 5-309237645330 6-390842023950 7-141733920798 8-158913789983 9-412316860427' 2026-02-13T05:51:34.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:34.690 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-13T05:51:34.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528349 2026-02-13T05:51:34.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528349 2026-02-13T05:51:34.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574881 3-287762808854 4-90194313248 5-309237645330 6-390842023950 7-141733920798 8-158913789983 9-412316860427 10-193273528349' 2026-02-13T05:51:34.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:34.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836514 2026-02-13T05:51:34.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:34.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:51:34.756 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836514 2026-02-13T05:51:34.756 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:34.756 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836514 2026-02-13T05:51:34.757 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 21474836514 2026-02-13T05:51:34.757 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836514' 2026-02-13T05:51:34.757 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:51:34.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836512 -lt 21474836514 2026-02-13T05:51:34.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:51:35.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:51:35.980 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:51:36.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836514 -lt 21474836514 2026-02-13T05:51:36.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:36.204 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705698 2026-02-13T05:51:36.204 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:36.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:51:36.205 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705698 2026-02-13T05:51:36.205 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:36.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705698 2026-02-13T05:51:36.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705698' 2026-02-13T05:51:36.207 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 38654705698 2026-02-13T05:51:36.207 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:51:36.437 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705699 -lt 38654705698 2026-02-13T05:51:36.437 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:36.437 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574881 2026-02-13T05:51:36.437 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:36.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:51:36.439 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574881 2026-02-13T05:51:36.439 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:36.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574881 2026-02-13T05:51:36.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574881' 2026-02-13T05:51:36.441 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 55834574881 2026-02-13T05:51:36.441 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:51:36.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574881 -lt 55834574881 2026-02-13T05:51:36.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:36.666 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808854 2026-02-13T05:51:36.666 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:36.667 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:51:36.668 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808854 2026-02-13T05:51:36.668 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:36.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808854 2026-02-13T05:51:36.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808854' 2026-02-13T05:51:36.669 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 287762808854 2026-02-13T05:51:36.670 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:51:36.894 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808854 -lt 287762808854 2026-02-13T05:51:36.894 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:36.894 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313248 2026-02-13T05:51:36.895 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:36.895 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:51:36.896 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313248 2026-02-13T05:51:36.896 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:36.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313248 2026-02-13T05:51:36.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313248' 2026-02-13T05:51:36.898 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 90194313248 2026-02-13T05:51:36.898 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:51:37.123 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313248 -lt 90194313248 2026-02-13T05:51:37.123 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:37.123 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-309237645330 2026-02-13T05:51:37.124 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:37.124 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:51:37.125 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-309237645330 2026-02-13T05:51:37.125 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:37.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645330 2026-02-13T05:51:37.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 309237645330' 2026-02-13T05:51:37.127 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 309237645330 2026-02-13T05:51:37.127 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:51:37.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645330 -lt 309237645330 2026-02-13T05:51:37.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:37.349 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-390842023950 2026-02-13T05:51:37.349 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:37.350 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:51:37.350 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-390842023950 2026-02-13T05:51:37.350 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:37.351 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=390842023950 2026-02-13T05:51:37.352 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 390842023950 2026-02-13T05:51:37.352 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 390842023950' 2026-02-13T05:51:37.352 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:51:37.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 390842023950 -lt 390842023950 2026-02-13T05:51:37.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:37.572 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920798 2026-02-13T05:51:37.573 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:37.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-13T05:51:37.574 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920798 2026-02-13T05:51:37.574 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:37.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920798 2026-02-13T05:51:37.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920798' 2026-02-13T05:51:37.576 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.7 seq 141733920798 2026-02-13T05:51:37.576 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-13T05:51:37.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920799 -lt 141733920798 2026-02-13T05:51:37.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:37.799 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789983 2026-02-13T05:51:37.799 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:37.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-13T05:51:37.801 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789983 2026-02-13T05:51:37.801 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:37.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789983 2026-02-13T05:51:37.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789983' 2026-02-13T05:51:37.803 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.8 seq 158913789983 2026-02-13T05:51:37.803 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-13T05:51:38.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789983 -lt 158913789983 2026-02-13T05:51:38.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:38.028 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-412316860427 2026-02-13T05:51:38.028 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:38.029 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-13T05:51:38.029 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-412316860427 2026-02-13T05:51:38.030 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:38.030 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=412316860427 2026-02-13T05:51:38.030 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 412316860427' 2026-02-13T05:51:38.031 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.9 seq 412316860427 2026-02-13T05:51:38.031 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-13T05:51:38.254 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 412316860427 -lt 412316860427 2026-02-13T05:51:38.254 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:38.255 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528349 2026-02-13T05:51:38.255 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:38.256 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-13T05:51:38.257 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528349 2026-02-13T05:51:38.257 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:38.258 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528349 2026-02-13T05:51:38.258 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.10 seq 193273528349 2026-02-13T05:51:38.259 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528349' 2026-02-13T05:51:38.259 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-13T05:51:38.478 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528349 -lt 193273528349 2026-02-13T05:51:38.479 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:51:38.479 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:51:38.480 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:51:38.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 28 == 0 2026-02-13T05:51:38.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:51:38.787 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:51:38.787 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:51:38.787 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:51:38.787 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:51:38.787 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:51:38.788 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:51:39.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=28 2026-02-13T05:51:39.013 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:51:39.013 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:51:39.013 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:51:39.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 = 28 2026-02-13T05:51:39.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:51:39.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:51:39.323 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:128: rados_osds_out_in: get_osds pool-jerasure SOMETHING 2026-02-13T05:51:39.323 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:51:39.323 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:51:39.323 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-13T05:51:39.324 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:51:39.553 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=5 2026-02-13T05:51:39.553 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:51:39.553 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:51:39.553 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:51:39.553 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:51:39.553 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:51:39.553 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 5 1 9 4 3 10 2026-02-13T05:51:39.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:128: rados_osds_out_in: local 'osds_list=5 1 9 4 3 10' 2026-02-13T05:51:39.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:129: rados_osds_out_in: osds=('5' '1' '9' '4' '3' '10') 2026-02-13T05:51:39.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:129: rados_osds_out_in: local -a osds 2026-02-13T05:51:39.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:130: rados_osds_out_in: for osd in 0 1 2026-02-13T05:51:39.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:131: rados_osds_out_in: ceph osd out 5 2026-02-13T05:51:39.805 INFO:tasks.workunit.client.0.trial024.stderr:osd.5 is already out. 2026-02-13T05:51:39.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:130: rados_osds_out_in: for osd in 0 1 2026-02-13T05:51:39.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:131: rados_osds_out_in: ceph osd out 1 2026-02-13T05:51:40.112 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 is already out. 2026-02-13T05:51:40.121 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:133: rados_osds_out_in: wait_for_clean 2026-02-13T05:51:40.121 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:51:40.121 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:51:40.122 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:51:40.122 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:51:40.123 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:51:40.123 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:51:40.123 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:51:40.123 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:51:40.123 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:51:40.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:51:40.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:51:40.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:51:40.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:51:40.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:51:40.205 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:51:40.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:51:40.429 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:51:40.429 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:51:40.429 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:51:40.429 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:51:40.429 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:51:40.429 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:51:40.429 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:51:40.429 INFO:tasks.workunit.client.0.trial024.stderr:8 2026-02-13T05:51:40.429 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:51:40.430 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:51:40.430 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:51:40.430 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:40.430 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:51:40.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836517 2026-02-13T05:51:40.493 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836517 2026-02-13T05:51:40.493 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517' 2026-02-13T05:51:40.493 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:40.493 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:51:40.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705702 2026-02-13T05:51:40.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705702 2026-02-13T05:51:40.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702' 2026-02-13T05:51:40.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:40.558 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:51:40.625 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574884 2026-02-13T05:51:40.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574884 2026-02-13T05:51:40.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884' 2026-02-13T05:51:40.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:40.626 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:51:40.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808857 2026-02-13T05:51:40.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808857 2026-02-13T05:51:40.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857' 2026-02-13T05:51:40.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:40.689 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:51:40.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313251 2026-02-13T05:51:40.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313251 2026-02-13T05:51:40.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251' 2026-02-13T05:51:40.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:40.753 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:51:40.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645333 2026-02-13T05:51:40.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645333 2026-02-13T05:51:40.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251 5-309237645333' 2026-02-13T05:51:40.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:40.817 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:51:40.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=390842023953 2026-02-13T05:51:40.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 390842023953 2026-02-13T05:51:40.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251 5-309237645333 6-390842023953' 2026-02-13T05:51:40.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:40.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-13T05:51:40.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920802 2026-02-13T05:51:40.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920802 2026-02-13T05:51:40.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251 5-309237645333 6-390842023953 7-141733920802' 2026-02-13T05:51:40.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:40.945 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-13T05:51:41.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789986 2026-02-13T05:51:41.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789986 2026-02-13T05:51:41.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251 5-309237645333 6-390842023953 7-141733920802 8-158913789986' 2026-02-13T05:51:41.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:41.009 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-13T05:51:41.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=412316860430 2026-02-13T05:51:41.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 412316860430 2026-02-13T05:51:41.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251 5-309237645333 6-390842023953 7-141733920802 8-158913789986 9-412316860430' 2026-02-13T05:51:41.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:41.072 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-13T05:51:41.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528352 2026-02-13T05:51:41.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528352 2026-02-13T05:51:41.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836517 1-38654705702 2-55834574884 3-287762808857 4-90194313251 5-309237645333 6-390842023953 7-141733920802 8-158913789986 9-412316860430 10-193273528352' 2026-02-13T05:51:41.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:41.136 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836517 2026-02-13T05:51:41.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:41.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:51:41.138 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836517 2026-02-13T05:51:41.138 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:41.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836517 2026-02-13T05:51:41.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836517' 2026-02-13T05:51:41.139 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 21474836517 2026-02-13T05:51:41.139 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:51:41.366 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836515 -lt 21474836517 2026-02-13T05:51:41.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:51:42.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:51:42.368 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:51:42.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836517 -lt 21474836517 2026-02-13T05:51:42.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:42.596 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705702 2026-02-13T05:51:42.597 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:42.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:51:42.598 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705702 2026-02-13T05:51:42.598 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:42.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705702 2026-02-13T05:51:42.599 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 38654705702 2026-02-13T05:51:42.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705702' 2026-02-13T05:51:42.600 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:51:42.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705702 -lt 38654705702 2026-02-13T05:51:42.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:42.826 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574884 2026-02-13T05:51:42.826 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:42.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:51:42.828 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574884 2026-02-13T05:51:42.828 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:42.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574884 2026-02-13T05:51:42.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574884' 2026-02-13T05:51:42.829 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 55834574884 2026-02-13T05:51:42.829 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:51:43.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574884 -lt 55834574884 2026-02-13T05:51:43.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:43.059 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808857 2026-02-13T05:51:43.059 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:43.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:51:43.061 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808857 2026-02-13T05:51:43.061 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:43.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808857 2026-02-13T05:51:43.062 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 287762808857 2026-02-13T05:51:43.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808857' 2026-02-13T05:51:43.063 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:51:43.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808857 -lt 287762808857 2026-02-13T05:51:43.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:43.285 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313251 2026-02-13T05:51:43.286 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:43.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:51:43.287 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313251 2026-02-13T05:51:43.287 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:43.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313251 2026-02-13T05:51:43.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313251' 2026-02-13T05:51:43.289 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 90194313251 2026-02-13T05:51:43.289 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:51:43.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313251 -lt 90194313251 2026-02-13T05:51:43.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:43.514 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-309237645333 2026-02-13T05:51:43.514 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:43.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:51:43.515 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-309237645333 2026-02-13T05:51:43.515 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:43.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645333 2026-02-13T05:51:43.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 309237645333' 2026-02-13T05:51:43.517 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 309237645333 2026-02-13T05:51:43.517 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:51:43.741 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645334 -lt 309237645333 2026-02-13T05:51:43.741 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:43.742 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-390842023953 2026-02-13T05:51:43.742 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:43.742 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:51:43.743 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-390842023953 2026-02-13T05:51:43.743 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:43.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=390842023953 2026-02-13T05:51:43.745 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 390842023953 2026-02-13T05:51:43.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 390842023953' 2026-02-13T05:51:43.745 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:51:43.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 390842023954 -lt 390842023953 2026-02-13T05:51:43.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:43.978 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920802 2026-02-13T05:51:43.978 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:43.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-13T05:51:43.979 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920802 2026-02-13T05:51:43.980 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:43.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920802 2026-02-13T05:51:43.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920802' 2026-02-13T05:51:43.981 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.7 seq 141733920802 2026-02-13T05:51:43.981 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-13T05:51:44.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920802 -lt 141733920802 2026-02-13T05:51:44.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:44.204 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789986 2026-02-13T05:51:44.204 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:44.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-13T05:51:44.205 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789986 2026-02-13T05:51:44.205 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:44.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789986 2026-02-13T05:51:44.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789986' 2026-02-13T05:51:44.207 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.8 seq 158913789986 2026-02-13T05:51:44.207 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-13T05:51:44.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789987 -lt 158913789986 2026-02-13T05:51:44.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:44.430 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-412316860430 2026-02-13T05:51:44.430 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:44.431 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-13T05:51:44.432 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-412316860430 2026-02-13T05:51:44.432 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:44.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=412316860430 2026-02-13T05:51:44.433 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.9 seq 412316860430 2026-02-13T05:51:44.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 412316860430' 2026-02-13T05:51:44.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-13T05:51:44.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 412316860430 -lt 412316860430 2026-02-13T05:51:44.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:44.658 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528352 2026-02-13T05:51:44.659 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:44.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-13T05:51:44.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528352 2026-02-13T05:51:44.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:44.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528352 2026-02-13T05:51:44.662 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.10 seq 193273528352 2026-02-13T05:51:44.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528352' 2026-02-13T05:51:44.662 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-13T05:51:44.893 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528353 -lt 193273528352 2026-02-13T05:51:44.894 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:51:44.894 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:51:44.894 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:51:45.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 28 == 0 2026-02-13T05:51:45.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:51:45.207 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:51:45.207 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:51:45.207 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:51:45.207 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:51:45.207 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:51:45.208 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:51:45.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=28 2026-02-13T05:51:45.429 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:51:45.429 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:51:45.430 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:51:45.740 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 = 28 2026-02-13T05:51:45.741 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:51:45.741 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:51:45.741 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:137: rados_osds_out_in: for osd in 0 1 2026-02-13T05:51:45.741 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:138: rados_osds_out_in: get_osds pool-jerasure SOMETHING 2026-02-13T05:51:45.741 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:51:45.741 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:51:45.741 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:138: rados_osds_out_in: grep '\<5\>' 2026-02-13T05:51:45.741 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-13T05:51:45.741 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:51:45.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2 2026-02-13T05:51:45.973 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:51:45.973 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:51:45.973 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:51:45.974 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:51:45.974 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:51:45.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2 7 9 4 3 10 2026-02-13T05:51:45.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:137: rados_osds_out_in: for osd in 0 1 2026-02-13T05:51:45.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:138: rados_osds_out_in: get_osds pool-jerasure SOMETHING 2026-02-13T05:51:45.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:51:45.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:138: rados_osds_out_in: grep '\<1\>' 2026-02-13T05:51:45.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:51:45.975 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-13T05:51:45.975 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:51:46.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2 2026-02-13T05:51:46.203 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:51:46.203 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:51:46.203 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:51:46.203 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:51:46.203 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:51:46.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2 7 9 4 3 10 2026-02-13T05:51:46.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:140: rados_osds_out_in: rados --pool pool-jerasure get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:51:46.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:141: rados_osds_out_in: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:51:46.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:147: rados_osds_out_in: for osd in 0 1 2026-02-13T05:51:46.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:148: rados_osds_out_in: ceph osd in 5 2026-02-13T05:51:46.501 INFO:tasks.workunit.client.0.trial024.stderr:osd.5 is already in. 2026-02-13T05:51:46.510 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:147: rados_osds_out_in: for osd in 0 1 2026-02-13T05:51:46.511 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:148: rados_osds_out_in: ceph osd in 1 2026-02-13T05:51:46.809 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 is already in. 2026-02-13T05:51:46.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:150: rados_osds_out_in: wait_for_clean 2026-02-13T05:51:46.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:51:46.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:51:46.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:51:46.819 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:51:46.819 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:51:46.819 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:51:46.819 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:51:46.819 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:51:46.819 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:51:46.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:51:46.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:51:46.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:51:46.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:51:46.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:51:46.903 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:51:47.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:51:47.134 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:51:47.134 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:51:47.134 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:51:47.135 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:51:47.135 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:51:47.135 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:51:47.135 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:51:47.135 INFO:tasks.workunit.client.0.trial024.stderr:8 2026-02-13T05:51:47.135 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:51:47.135 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:51:47.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:51:47.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:47.136 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:51:47.199 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836520 2026-02-13T05:51:47.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836520 2026-02-13T05:51:47.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520' 2026-02-13T05:51:47.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:47.200 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:51:47.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705705 2026-02-13T05:51:47.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705705 2026-02-13T05:51:47.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705' 2026-02-13T05:51:47.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:47.264 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:51:47.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574887 2026-02-13T05:51:47.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574887 2026-02-13T05:51:47.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887' 2026-02-13T05:51:47.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:47.326 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:51:47.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808860 2026-02-13T05:51:47.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808860 2026-02-13T05:51:47.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860' 2026-02-13T05:51:47.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:47.390 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:51:47.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313254 2026-02-13T05:51:47.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313254 2026-02-13T05:51:47.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254' 2026-02-13T05:51:47.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:47.453 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:51:47.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645337 2026-02-13T05:51:47.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645337 2026-02-13T05:51:47.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254 5-309237645337' 2026-02-13T05:51:47.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:47.518 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:51:47.582 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=390842023957 2026-02-13T05:51:47.582 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 390842023957 2026-02-13T05:51:47.582 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254 5-309237645337 6-390842023957' 2026-02-13T05:51:47.582 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:47.582 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-13T05:51:47.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920805 2026-02-13T05:51:47.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920805 2026-02-13T05:51:47.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254 5-309237645337 6-390842023957 7-141733920805' 2026-02-13T05:51:47.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:47.647 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-13T05:51:47.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789989 2026-02-13T05:51:47.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789989 2026-02-13T05:51:47.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254 5-309237645337 6-390842023957 7-141733920805 8-158913789989' 2026-02-13T05:51:47.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:47.711 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-13T05:51:47.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=412316860433 2026-02-13T05:51:47.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 412316860433 2026-02-13T05:51:47.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254 5-309237645337 6-390842023957 7-141733920805 8-158913789989 9-412316860433' 2026-02-13T05:51:47.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:51:47.775 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-13T05:51:47.838 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528355 2026-02-13T05:51:47.838 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528355 2026-02-13T05:51:47.838 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836520 1-38654705705 2-55834574887 3-287762808860 4-90194313254 5-309237645337 6-390842023957 7-141733920805 8-158913789989 9-412316860433 10-193273528355' 2026-02-13T05:51:47.838 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:47.839 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836520 2026-02-13T05:51:47.839 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:47.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:51:47.841 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836520 2026-02-13T05:51:47.841 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:47.841 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836520 2026-02-13T05:51:47.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836520' 2026-02-13T05:51:47.842 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 21474836520 2026-02-13T05:51:47.842 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:51:48.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836520 -lt 21474836520 2026-02-13T05:51:48.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:48.064 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705705 2026-02-13T05:51:48.064 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:48.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:51:48.065 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705705 2026-02-13T05:51:48.065 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:48.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705705 2026-02-13T05:51:48.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705705' 2026-02-13T05:51:48.067 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 38654705705 2026-02-13T05:51:48.067 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:51:48.290 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705705 -lt 38654705705 2026-02-13T05:51:48.290 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:48.291 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574887 2026-02-13T05:51:48.291 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:48.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:51:48.293 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574887 2026-02-13T05:51:48.293 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:48.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574887 2026-02-13T05:51:48.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574887' 2026-02-13T05:51:48.294 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 55834574887 2026-02-13T05:51:48.295 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:51:48.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574888 -lt 55834574887 2026-02-13T05:51:48.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:48.518 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808860 2026-02-13T05:51:48.518 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:48.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:51:48.520 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-287762808860 2026-02-13T05:51:48.520 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:48.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808860 2026-02-13T05:51:48.521 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 287762808860 2026-02-13T05:51:48.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 287762808860' 2026-02-13T05:51:48.522 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:51:48.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808860 -lt 287762808860 2026-02-13T05:51:48.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:48.748 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-90194313254 2026-02-13T05:51:48.748 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:48.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:51:48.749 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-90194313254 2026-02-13T05:51:48.750 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:48.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=90194313254 2026-02-13T05:51:48.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 90194313254' 2026-02-13T05:51:48.751 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 90194313254 2026-02-13T05:51:48.751 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:51:48.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 90194313254 -lt 90194313254 2026-02-13T05:51:48.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:48.973 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-309237645337 2026-02-13T05:51:48.973 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:48.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:51:48.975 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-309237645337 2026-02-13T05:51:48.975 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:48.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645337 2026-02-13T05:51:48.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 309237645337' 2026-02-13T05:51:48.976 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 309237645337 2026-02-13T05:51:48.976 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:51:49.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645337 -lt 309237645337 2026-02-13T05:51:49.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:49.201 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-390842023957 2026-02-13T05:51:49.201 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:49.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:51:49.203 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-390842023957 2026-02-13T05:51:49.203 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:49.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=390842023957 2026-02-13T05:51:49.204 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 390842023957 2026-02-13T05:51:49.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 390842023957' 2026-02-13T05:51:49.205 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:51:49.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 390842023957 -lt 390842023957 2026-02-13T05:51:49.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:49.430 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-141733920805 2026-02-13T05:51:49.430 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:49.431 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-13T05:51:49.432 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-141733920805 2026-02-13T05:51:49.432 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:49.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920805 2026-02-13T05:51:49.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 141733920805' 2026-02-13T05:51:49.434 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.7 seq 141733920805 2026-02-13T05:51:49.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-13T05:51:49.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920803 -lt 141733920805 2026-02-13T05:51:49.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:51:50.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:51:50.661 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-13T05:51:50.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920805 -lt 141733920805 2026-02-13T05:51:50.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:50.888 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-158913789989 2026-02-13T05:51:50.888 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:50.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-13T05:51:50.889 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-158913789989 2026-02-13T05:51:50.890 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:50.891 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789989 2026-02-13T05:51:50.891 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 158913789989' 2026-02-13T05:51:50.891 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.8 seq 158913789989 2026-02-13T05:51:50.892 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-13T05:51:51.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789990 -lt 158913789989 2026-02-13T05:51:51.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:51.117 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-412316860433 2026-02-13T05:51:51.117 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:51.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=9 2026-02-13T05:51:51.118 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 9-412316860433 2026-02-13T05:51:51.118 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:51.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=412316860433 2026-02-13T05:51:51.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.9 seq 412316860433' 2026-02-13T05:51:51.120 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.9 seq 412316860433 2026-02-13T05:51:51.120 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-13T05:51:51.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 412316860434 -lt 412316860433 2026-02-13T05:51:51.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:51:51.346 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 10-193273528355 2026-02-13T05:51:51.346 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:51:51.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=10 2026-02-13T05:51:51.348 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 10-193273528355 2026-02-13T05:51:51.348 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:51:51.349 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528355 2026-02-13T05:51:51.349 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.10 seq 193273528355' 2026-02-13T05:51:51.350 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.10 seq 193273528355 2026-02-13T05:51:51.350 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-13T05:51:51.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528356 -lt 193273528355 2026-02-13T05:51:51.575 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:51:51.575 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:51:51.575 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:51:51.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 28 == 0 2026-02-13T05:51:51.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:51:51.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:51:51.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:51:51.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:51:51.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:51:51.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:51:51.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:51:52.106 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=28 2026-02-13T05:51:52.106 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:51:52.107 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:51:52.107 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:51:52.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 = 28 2026-02-13T05:51:52.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:51:52.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:51:52.424 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:151: rados_osds_out_in: get_osds pool-jerasure SOMETHING 2026-02-13T05:51:52.424 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:51:52.424 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:51:52.424 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-13T05:51:52.424 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:51:52.650 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=5 2026-02-13T05:51:52.650 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:51:52.650 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:51:52.651 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:51:52.651 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:51:52.651 INFO:tasks.workunit.client.0.trial024.stderr:10' 2026-02-13T05:51:52.651 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 5 1 9 4 3 10 2026-02-13T05:51:52.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:151: rados_osds_out_in: test '5 1 9 4 3 10' = '5 1 9 4 3 10' 2026-02-13T05:51:52.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:152: rados_osds_out_in: rm td/test-erasure-code/ORIGINAL 2026-02-13T05:51:52.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:229: TEST_rados_put_get_jerasure: delete_pool pool-jerasure 2026-02-13T05:51:52.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=pool-jerasure 2026-02-13T05:51:52.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T05:51:52.895 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T05:51:52.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:230: TEST_rados_put_get_jerasure: ceph osd erasure-code-profile rm profile-jerasure 2026-02-13T05:51:53.179 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile profile-jerasure does not exist 2026-02-13T05:51:53.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-13T05:51:53.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_lrc_advanced td/test-erasure-code 2026-02-13T05:51:53.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:156: TEST_rados_put_get_lrc_advanced: local dir=td/test-erasure-code 2026-02-13T05:51:53.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:157: TEST_rados_put_get_lrc_advanced: local poolname=pool-lrc-a 2026-02-13T05:51:53.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:158: TEST_rados_put_get_lrc_advanced: local profile=profile-lrc-a 2026-02-13T05:51:53.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:160: TEST_rados_put_get_lrc_advanced: ceph osd erasure-code-profile set profile-lrc-a plugin=lrc mapping=DD_ 'crush-steps=[ [ "chooseleaf", "osd", 0 ] ]' 'layers=[ [ "DDc", "" ] ]' 2026-02-13T05:51:53.476 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:165: TEST_rados_put_get_lrc_advanced: create_pool pool-lrc-a 12 12 erasure profile-lrc-a 2026-02-13T05:51:53.476 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-lrc-a 12 12 erasure profile-lrc-a 2026-02-13T05:51:53.850 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-lrc-a' already exists 2026-02-13T05:51:53.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:51:54.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:168: TEST_rados_put_get_lrc_advanced: rados_put_get td/test-erasure-code pool-lrc-a 2026-02-13T05:51:54.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-13T05:51:54.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-lrc-a 2026-02-13T05:51:54.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-13T05:51:54.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:54.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-13T05:51:54.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:54.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-13T05:51:54.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:54.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-13T05:51:54.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:51:54.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-13T05:51:54.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-lrc-a put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-13T05:51:54.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-lrc-a get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:51:54.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:51:54.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-13T05:51:54.901 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-lrc-a SOMETHING 2026-02-13T05:51:54.901 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-lrc-a 2026-02-13T05:51:54.902 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:51:54.902 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-lrc-a SOMETHING 2026-02-13T05:51:54.902 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:51:55.130 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=5 2026-02-13T05:51:55.130 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:51:55.130 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:51:55.130 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 5 9 3 2026-02-13T05:51:55.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('5' '9' '3') 2026-02-13T05:51:55.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-13T05:51:55.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=2 2026-02-13T05:51:55.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 3 2026-02-13T05:51:55.377 INFO:tasks.workunit.client.0.trial024.stderr:osd.3 is already out. 2026-02-13T05:51:55.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-13T05:52:00.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-lrc-a SOMETHING 2026-02-13T05:52:00.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-lrc-a 2026-02-13T05:52:00.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:52:00.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<3\>' 2026-02-13T05:52:00.388 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-lrc-a SOMETHING 2026-02-13T05:52:00.389 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:52:00.613 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=5 2026-02-13T05:52:00.613 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:52:00.613 INFO:tasks.workunit.client.0.trial024.stderr:7' 2026-02-13T05:52:00.614 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 5 9 7 2026-02-13T05:52:00.614 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-lrc-a get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:52:00.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:52:00.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 3 2026-02-13T05:52:00.918 INFO:tasks.workunit.client.0.trial024.stderr:osd.3 is already in. 2026-02-13T05:52:00.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-13T05:52:00.928 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:170: TEST_rados_put_get_lrc_advanced: delete_pool pool-lrc-a 2026-02-13T05:52:00.929 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=pool-lrc-a 2026-02-13T05:52:00.929 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete pool-lrc-a pool-lrc-a --yes-i-really-really-mean-it 2026-02-13T05:52:01.218 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-lrc-a' does not exist 2026-02-13T05:52:01.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:171: TEST_rados_put_get_lrc_advanced: ceph osd erasure-code-profile rm profile-lrc-a 2026-02-13T05:52:01.503 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile profile-lrc-a does not exist 2026-02-13T05:52:01.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-13T05:52:01.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_lrc_kml td/test-erasure-code 2026-02-13T05:52:01.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:175: TEST_rados_put_get_lrc_kml: local dir=td/test-erasure-code 2026-02-13T05:52:01.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:176: TEST_rados_put_get_lrc_kml: local poolname=pool-lrc 2026-02-13T05:52:01.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:177: TEST_rados_put_get_lrc_kml: local profile=profile-lrc 2026-02-13T05:52:01.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:179: TEST_rados_put_get_lrc_kml: ceph osd erasure-code-profile set profile-lrc plugin=lrc k=4 m=2 l=3 crush-failure-domain=osd 2026-02-13T05:52:01.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:183: TEST_rados_put_get_lrc_kml: create_pool pool-lrc 12 12 erasure profile-lrc 2026-02-13T05:52:01.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-lrc 12 12 erasure profile-lrc 2026-02-13T05:52:02.192 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-lrc' already exists 2026-02-13T05:52:02.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:52:03.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:186: TEST_rados_put_get_lrc_kml: rados_put_get td/test-erasure-code pool-lrc 2026-02-13T05:52:03.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-13T05:52:03.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-lrc 2026-02-13T05:52:03.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-13T05:52:03.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:52:03.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-13T05:52:03.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:52:03.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-13T05:52:03.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:52:03.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-13T05:52:03.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:52:03.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-13T05:52:03.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-lrc put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-13T05:52:03.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-lrc get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:52:03.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:52:03.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-13T05:52:03.248 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-lrc SOMETHING 2026-02-13T05:52:03.248 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-lrc 2026-02-13T05:52:03.248 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:52:03.249 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-lrc SOMETHING 2026-02-13T05:52:03.249 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:52:03.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=8 2026-02-13T05:52:03.474 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:52:03.474 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:52:03.474 INFO:tasks.workunit.client.0.trial024.stderr:10 2026-02-13T05:52:03.474 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:52:03.474 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:52:03.474 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:52:03.474 INFO:tasks.workunit.client.0.trial024.stderr:7' 2026-02-13T05:52:03.474 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 8 6 0 10 5 3 9 7 2026-02-13T05:52:03.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('8' '6' '0' '10' '5' '3' '9' '7') 2026-02-13T05:52:03.475 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-13T05:52:03.475 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=7 2026-02-13T05:52:03.475 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 7 2026-02-13T05:52:03.724 INFO:tasks.workunit.client.0.trial024.stderr:osd.7 is already out. 2026-02-13T05:52:03.733 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-13T05:52:08.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-lrc SOMETHING 2026-02-13T05:52:08.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-lrc 2026-02-13T05:52:08.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:52:08.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<7\>' 2026-02-13T05:52:08.736 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-lrc SOMETHING 2026-02-13T05:52:08.737 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:52:08.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=8 2026-02-13T05:52:08.960 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:52:08.960 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:52:08.960 INFO:tasks.workunit.client.0.trial024.stderr:10 2026-02-13T05:52:08.960 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:52:08.960 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:52:08.960 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:52:08.960 INFO:tasks.workunit.client.0.trial024.stderr:4' 2026-02-13T05:52:08.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 8 6 0 10 5 3 9 4 2026-02-13T05:52:08.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-lrc get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:52:08.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:52:08.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 7 2026-02-13T05:52:09.215 INFO:tasks.workunit.client.0.trial024.stderr:osd.7 is already in. 2026-02-13T05:52:09.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-13T05:52:09.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:188: TEST_rados_put_get_lrc_kml: delete_pool pool-lrc 2026-02-13T05:52:09.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=pool-lrc 2026-02-13T05:52:09.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete pool-lrc pool-lrc --yes-i-really-really-mean-it 2026-02-13T05:52:09.511 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-lrc' does not exist 2026-02-13T05:52:09.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:189: TEST_rados_put_get_lrc_kml: ceph osd erasure-code-profile rm profile-lrc 2026-02-13T05:52:09.817 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile profile-lrc does not exist 2026-02-13T05:52:09.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-13T05:52:09.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_shec td/test-erasure-code 2026-02-13T05:52:09.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:234: TEST_rados_put_get_shec: local dir=td/test-erasure-code 2026-02-13T05:52:09.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:236: TEST_rados_put_get_shec: local poolname=pool-shec 2026-02-13T05:52:09.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:237: TEST_rados_put_get_shec: local profile=profile-shec 2026-02-13T05:52:09.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:239: TEST_rados_put_get_shec: ceph osd erasure-code-profile set profile-shec plugin=shec k=2 m=1 c=1 crush-failure-domain=osd 2026-02-13T05:52:10.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:243: TEST_rados_put_get_shec: create_pool pool-shec 12 12 erasure profile-shec 2026-02-13T05:52:10.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-shec 12 12 erasure profile-shec 2026-02-13T05:52:10.490 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-shec' already exists 2026-02-13T05:52:10.499 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:52:11.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:246: TEST_rados_put_get_shec: rados_put_get td/test-erasure-code pool-shec 2026-02-13T05:52:11.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-13T05:52:11.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-shec 2026-02-13T05:52:11.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-13T05:52:11.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:52:11.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-13T05:52:11.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:52:11.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-13T05:52:11.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:52:11.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-13T05:52:11.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-13T05:52:11.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-13T05:52:11.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-shec put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-13T05:52:11.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-shec get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:52:11.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:52:11.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-13T05:52:11.543 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-shec SOMETHING 2026-02-13T05:52:11.543 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-shec 2026-02-13T05:52:11.544 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:52:11.544 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-shec SOMETHING 2026-02-13T05:52:11.544 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:52:11.769 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=7 2026-02-13T05:52:11.770 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:52:11.770 INFO:tasks.workunit.client.0.trial024.stderr:1' 2026-02-13T05:52:11.770 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 7 9 1 2026-02-13T05:52:11.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('7' '9' '1') 2026-02-13T05:52:11.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-13T05:52:11.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=2 2026-02-13T05:52:11.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 1 2026-02-13T05:52:12.048 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 is already out. 2026-02-13T05:52:12.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-13T05:52:17.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-shec SOMETHING 2026-02-13T05:52:17.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-shec 2026-02-13T05:52:17.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-13T05:52:17.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<1\>' 2026-02-13T05:52:17.059 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-shec SOMETHING 2026-02-13T05:52:17.059 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:52:17.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=7 2026-02-13T05:52:17.289 INFO:tasks.workunit.client.0.trial024.stderr:9 2026-02-13T05:52:17.290 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:52:17.290 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 7 9 6 2026-02-13T05:52:17.290 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-shec get SOMETHING td/test-erasure-code/COPY 2026-02-13T05:52:17.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-13T05:52:17.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 1 2026-02-13T05:52:17.597 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 is already in. 2026-02-13T05:52:17.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-13T05:52:17.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:248: TEST_rados_put_get_shec: delete_pool pool-shec 2026-02-13T05:52:17.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=pool-shec 2026-02-13T05:52:17.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete pool-shec pool-shec --yes-i-really-really-mean-it 2026-02-13T05:52:17.895 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-shec' does not exist 2026-02-13T05:52:17.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:249: TEST_rados_put_get_shec: ceph osd erasure-code-profile rm profile-shec 2026-02-13T05:52:18.180 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile profile-shec does not exist 2026-02-13T05:52:18.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:51: run: delete_pool ecpool 2026-02-13T05:52:18.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=ecpool 2026-02-13T05:52:18.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete ecpool ecpool --yes-i-really-really-mean-it 2026-02-13T05:52:18.461 INFO:tasks.workunit.client.0.trial024.stderr:pool 'ecpool' does not exist 2026-02-13T05:52:18.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:52: run: teardown td/test-erasure-code 2026-02-13T05:52:18.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code 2026-02-13T05:52:18.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:52:18.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code KILL 2026-02-13T05:52:18.471 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:52:18.471 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:52:18.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:52:18.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:52:18.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:52:18.582 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:52:18.583 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:52:18.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:52:18.584 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:52:18.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:52:18.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:52:18.586 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:52:18.586 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:52:18.586 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:52:18.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:52:18.587 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:52:18.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:52:18.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:52:18.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code 2026-02-13T05:52:18.643 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:52:18.644 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:18.644 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:52:18.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.44477 2026-02-13T05:52:18.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:52:18.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:52:18.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-13T05:52:18.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/test-erasure-code 0 2026-02-13T05:52:18.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-code 2026-02-13T05:52:18.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-13T05:52:18.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-code KILL 2026-02-13T05:52:18.647 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:52:18.647 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:52:18.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:52:18.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:52:18.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:52:18.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:52:18.648 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:52:18.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:52:18.648 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:52:18.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:52:18.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:52:18.649 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:52:18.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:52:18.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:52:18.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:52:18.651 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:52:18.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:52:18.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-13T05:52:18.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-code 2026-02-13T05:52:18.654 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:52:18.654 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:18.654 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44477 2026-02-13T05:52:18.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.44477 2026-02-13T05:52:18.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:52:18.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:52:18.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-13T05:52:18.656 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-13T05:52:18.656 DEBUG:teuthology.orchestra.run.trial024:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T05:52:18.681 INFO:tasks.workunit:Running workunit erasure-code/test-erasure-eio.sh... 2026-02-13T05:52:18.681 DEBUG:teuthology.orchestra.run.trial024:workunit test erasure-code/test-erasure-eio.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh 2026-02-13T05:52:18.743 INFO:tasks.workunit.client.0.trial024.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T05:52:18.747 INFO:tasks.workunit.client.0.trial024.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T05:52:18.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-13T05:52:18.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-13T05:52:18.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/test-erasure-eio 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:22: run: local dir=td/test-erasure-eio 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:23: run: shift 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:25: run: export CEPH_MON=127.0.0.1:7112 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:25: run: CEPH_MON=127.0.0.1:7112 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:26: run: export CEPH_ARGS 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:27: run: uuidgen 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:27: run: CEPH_ARGS+='--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none ' 2026-02-13T05:52:18.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7112 ' 2026-02-13T05:52:18.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:29: run: CEPH_ARGS+='--osd_mclock_override_recovery_settings=true ' 2026-02-13T05:52:18.749 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:31: run: set 2026-02-13T05:52:18.749 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T05:52:18.750 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:31: run: local 'funcs=TEST_ec_backfill_unfound 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_ec_object_attr_read_error 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_ec_recovery_multiple_errors 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_ec_recovery_multiple_objects 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_ec_recovery_multiple_objects_eio 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_ec_recovery_unfound 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_ec_single_recovery_error 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_rados_get_bad_size_shard_0 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_rados_get_bad_size_shard_1 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_rados_get_subread_eio_shard_0 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_rados_get_subread_eio_shard_1 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_rados_get_subread_missing 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_rados_get_with_subreadall_eio_shard_0 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:TEST_rados_get_with_subreadall_eio_shard_1' 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:52:18.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:52:18.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:52:18.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:52:18.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:52:18.752 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:52:18.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:52:18.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:52:18.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:52:18.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:52:18.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:52:18.756 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:52:18.756 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:52:18.756 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:52:18.756 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:52:18.756 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:52:18.757 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:52:18.757 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:52:18.758 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:52:18.759 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:18.759 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:18.759 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:52:18.759 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:52:18.759 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:52:18.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T05:52:18.760 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:52:18.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:18.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:18.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T05:52:18.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:52:18.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T05:52:18.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T05:52:18.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:52:18.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T05:52:18.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T05:52:18.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T05:52:18.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:52:18.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:52:18.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:52:18.764 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T05:52:18.764 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T05:52:18.784 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:52:18.784 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:52:18.784 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:52:18.784 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:52:18.784 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:18.784 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:18.784 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:18.785 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:52:18.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:52:18.812 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:52:18.812 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:52:18.812 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:52:18.813 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:52:18.813 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:52:18.814 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:52:18.814 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:52:18.814 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:52:18.814 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:52:18.814 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:18.814 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:18.814 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:52:18.814 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:52:18.814 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T05:52:18.859 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:52:18.859 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:52:18.859 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:52:18.859 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:52:18.859 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:52:18.860 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:52:18.860 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:52:18.860 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:52:18.860 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:52:18.860 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:18.861 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:18.861 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:52:18.861 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:52:18.861 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T05:52:18.905 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T05:52:18.905 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T05:52:18.905 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:52:18.905 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:52:18.905 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:52:18.905 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T05:52:18.905 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:52:19.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:52:19.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:52:19.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:52:19.006 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:52:19.007 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:19.007 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:19.007 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:19.007 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:52:19.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:52:19.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T05:52:19.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:52:19.121 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:52:19.127 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:52:20.129 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T05:52:20.138 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:52:20.138 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:52:20.139 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:52:20.139 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:20.139 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:20.139 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:52:20.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T05:52:20.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T05:52:20.170 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:52:20.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T05:52:20.175 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:52:18.803+0000 7f07b3c23d80 0 load: jerasure load: lrc 2026-02-13T05:52:20.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_backfill_unfound td/test-erasure-eio 2026-02-13T05:52:20.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:531: TEST_ec_backfill_unfound: local dir=td/test-erasure-eio 2026-02-13T05:52:20.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:532: TEST_ec_backfill_unfound: local objname=myobject 2026-02-13T05:52:20.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:533: TEST_ec_backfill_unfound: local lastobj=300 2026-02-13T05:52:20.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:535: TEST_ec_backfill_unfound: local testobj=obj250 2026-02-13T05:52:20.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:537: TEST_ec_backfill_unfound: ORIG_ARGS='--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:52:20.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:538: TEST_ec_backfill_unfound: CEPH_ARGS+=' --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-13T05:52:20.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: setup_osds 5 2026-02-13T05:52:20.178 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=5 2026-02-13T05:52:20.178 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T05:52:20.178 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 5 - 1 2026-02-13T05:52:20.178 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 4 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:20.181 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6e117c2a-6284-45ae-8070-ccb83f256744 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 6e117c2a-6284-45ae-8070-ccb83f256744' 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 6e117c2a-6284-45ae-8070-ccb83f256744 2026-02-13T05:52:20.182 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:52:20.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAUvI5pJX98CxAA/ptBrECiUXMobFS/uenPcw== 2026-02-13T05:52:20.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAUvI5pJX98CxAA/ptBrECiUXMobFS/uenPcw=="}' 2026-02-13T05:52:20.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6e117c2a-6284-45ae-8070-ccb83f256744 -i td/test-erasure-eio/0/new.json 2026-02-13T05:52:20.296 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:52:20.302 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T05:52:20.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAUvI5pJX98CxAA/ptBrECiUXMobFS/uenPcw== --osd-uuid 6e117c2a-6284-45ae-8070-ccb83f256744 2026-02-13T05:52:20.323 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:20.322+0000 7f939c8ec900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:20.325 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:20.323+0000 7f939c8ec900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:20.326 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:20.324+0000 7f939c8ec900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:20.326 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:20.325+0000 7f939c8ec900 -1 bdev(0x561039418c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:52:20.326 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:20.325+0000 7f939c8ec900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T05:52:20.733 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T05:52:20.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:52:20.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:52:20.735 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:52:20.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:52:20.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:52:20.842 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:52:20.843 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:52:20.843 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:52:20.843 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:52:20.843 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:52:20.861 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:20.860+0000 7fdffc995900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:20.862 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:20.861+0000 7fdffc995900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:20.863 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:20.862+0000 7fdffc995900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:20.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:52:20.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:52:20.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:52:20.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:52:20.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:52:20.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:52:20.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:52:20.943 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:52:20.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:52:20.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:52:21.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:52:21.069 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:21.068+0000 7fdffc995900 -1 Falling back to public interface 2026-02-13T05:52:21.335 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:21.334+0000 7fdffc995900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:52:22.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:52:22.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:52:22.046 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:52:22.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:52:22.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:52:22.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:52:22.269 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3022007813,v1:127.0.0.1:6803/3022007813] [v2:127.0.0.1:6804/3022007813,v1:127.0.0.1:6805/3022007813] exists,up 6e117c2a-6284-45ae-8070-ccb83f256744 2026-02-13T05:52:22.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:52:22.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:52:22.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:52:22.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:52:22.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T05:52:22.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:52:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:52:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:52:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:52:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:52:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-13T05:52:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:52:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:52:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:52:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:52:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:52:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:52:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:52:22.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:52:22.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:52:22.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:52:22.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:52:22.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:52:22.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:52:22.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:52:22.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:52:22.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:52:22.276 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:52:22.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=98ae0d21-d768-4baf-b6a8-153dfdd316d2 2026-02-13T05:52:22.277 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 98ae0d21-d768-4baf-b6a8-153dfdd316d2 2026-02-13T05:52:22.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 98ae0d21-d768-4baf-b6a8-153dfdd316d2' 2026-02-13T05:52:22.277 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:52:22.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAWvI5pxecLERAAEFmaya2gWC/7Rm/kXUNw8A== 2026-02-13T05:52:22.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAWvI5pxecLERAAEFmaya2gWC/7Rm/kXUNw8A=="}' 2026-02-13T05:52:22.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 98ae0d21-d768-4baf-b6a8-153dfdd316d2 -i td/test-erasure-eio/1/new.json 2026-02-13T05:52:22.514 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:52:22.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T05:52:22.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAWvI5pxecLERAAEFmaya2gWC/7Rm/kXUNw8A== --osd-uuid 98ae0d21-d768-4baf-b6a8-153dfdd316d2 2026-02-13T05:52:22.540 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:22.539+0000 7fd907422900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:22.542 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:22.540+0000 7fd907422900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:22.543 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:22.541+0000 7fd907422900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:22.543 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:22.542+0000 7fd907422900 -1 bdev(0x556dbd618c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:52:22.543 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:22.542+0000 7fd907422900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T05:52:22.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T05:52:22.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:52:22.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:52:22.862 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:52:22.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:52:23.175 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:52:23.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:52:23.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:52:23.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:52:23.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:52:23.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:52:23.193 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:23.192+0000 7f792c95d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:23.195 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:23.193+0000 7f792c95d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:23.196 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:23.194+0000 7f792c95d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:23.329 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:23.328+0000 7f792c95d900 -1 Falling back to public interface 2026-02-13T05:52:23.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:52:23.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:52:23.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:52:23.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:52:23.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:52:23.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:52:23.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:52:23.402 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:52:23.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:52:23.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:52:23.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:52:23.629 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:23.627+0000 7f792c95d900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:52:24.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:52:24.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:52:24.630 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:52:24.630 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:52:24.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:52:24.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:52:24.854 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2159023970,v1:127.0.0.1:6811/2159023970] [v2:127.0.0.1:6812/2159023970,v1:127.0.0.1:6813/2159023970] exists,up 98ae0d21-d768-4baf-b6a8-153dfdd316d2 2026-02-13T05:52:24.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:52:24.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:52:24.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:52:24.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:52:24.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T05:52:24.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:52:24.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:52:24.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:52:24.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:52:24.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:52:24.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-13T05:52:24.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:52:24.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:52:24.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:52:24.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:52:24.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:52:24.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:52:24.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:52:24.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:52:24.860 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:52:24.860 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:52:24.860 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:52:24.860 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:52:24.860 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:24.860 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:24.860 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:24.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:24.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:52:24.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0a89b4df-0567-4e89-9dcf-6514dfbc7a55 2026-02-13T05:52:24.862 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 0a89b4df-0567-4e89-9dcf-6514dfbc7a55 2026-02-13T05:52:24.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 0a89b4df-0567-4e89-9dcf-6514dfbc7a55' 2026-02-13T05:52:24.862 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:52:24.873 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAYvI5pwhj2MxAAdEkeVzMVdUpGa41IpcPZMQ== 2026-02-13T05:52:24.873 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAYvI5pwhj2MxAAdEkeVzMVdUpGa41IpcPZMQ=="}' 2026-02-13T05:52:24.873 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0a89b4df-0567-4e89-9dcf-6514dfbc7a55 -i td/test-erasure-eio/2/new.json 2026-02-13T05:52:25.112 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:52:25.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T05:52:25.121 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAYvI5pwhj2MxAAdEkeVzMVdUpGa41IpcPZMQ== --osd-uuid 0a89b4df-0567-4e89-9dcf-6514dfbc7a55 2026-02-13T05:52:25.141 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:25.140+0000 7fa66e213900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:25.142 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:25.141+0000 7fa66e213900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:25.143 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:25.142+0000 7fa66e213900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:25.144 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:25.142+0000 7fa66e213900 -1 bdev(0x5567d3a70c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:52:25.144 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:25.142+0000 7fa66e213900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T05:52:25.466 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T05:52:25.466 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:52:25.467 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:52:25.467 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:52:25.468 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:52:25.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:52:25.786 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:52:25.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:52:25.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:52:25.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:52:25.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:52:25.805 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:25.805+0000 7f9cf8d05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:25.806 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:25.806+0000 7f9cf8d05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:25.807 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:25.807+0000 7f9cf8d05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:25.926 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:25.926+0000 7f9cf8d05900 -1 Falling back to public interface 2026-02-13T05:52:26.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:52:26.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:52:26.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:52:26.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:52:26.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:52:26.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:52:26.010 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:52:26.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:52:26.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:52:26.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:52:26.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:52:26.241 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:26.241+0000 7f9cf8d05900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:52:27.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:52:27.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:52:27.238 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:52:27.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:52:27.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:52:27.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:52:27.467 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 19 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2415291363,v1:127.0.0.1:6819/2415291363] [v2:127.0.0.1:6820/2415291363,v1:127.0.0.1:6821/2415291363] exists,up 0a89b4df-0567-4e89-9dcf-6514dfbc7a55 2026-02-13T05:52:27.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:52:27.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:52:27.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:52:27.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:52:27.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T05:52:27.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:52:27.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:52:27.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T05:52:27.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:52:27.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:52:27.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-13T05:52:27.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:52:27.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:52:27.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:52:27.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:52:27.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:52:27.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:52:27.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:52:27.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:52:27.472 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:52:27.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:52:27.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:52:27.473 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:52:27.473 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:27.473 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:27.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:27.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:27.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:52:27.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:52:27.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:52:27.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:52:27.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:52:27.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:52:27.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:52:27.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:52:27.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:52:27.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:52:27.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:52:27.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:52:27.474 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:52:27.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c96a6abe-6efb-446a-a3c0-ed0508413389 2026-02-13T05:52:27.474 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 c96a6abe-6efb-446a-a3c0-ed0508413389 2026-02-13T05:52:27.475 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 c96a6abe-6efb-446a-a3c0-ed0508413389' 2026-02-13T05:52:27.475 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:52:27.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAbvI5pwOfNHBAAphYkHCw4fxkV4QrEAJTfTA== 2026-02-13T05:52:27.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAbvI5pwOfNHBAAphYkHCw4fxkV4QrEAJTfTA=="}' 2026-02-13T05:52:27.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c96a6abe-6efb-446a-a3c0-ed0508413389 -i td/test-erasure-eio/3/new.json 2026-02-13T05:52:27.719 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T05:52:27.727 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T05:52:27.728 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAbvI5pwOfNHBAAphYkHCw4fxkV4QrEAJTfTA== --osd-uuid c96a6abe-6efb-446a-a3c0-ed0508413389 2026-02-13T05:52:27.748 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:27.747+0000 7f974473b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:27.749 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:27.749+0000 7f974473b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:27.750 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:27.749+0000 7f974473b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:27.750 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:27.750+0000 7f974473b900 -1 bdev(0x55cba90d8c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T05:52:27.750 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:27.750+0000 7f974473b900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T05:52:28.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T05:52:28.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:52:28.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T05:52:28.079 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T05:52:28.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:52:28.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T05:52:28.394 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:52:28.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:52:28.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:52:28.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:52:28.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:52:28.413 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:28.413+0000 7f2e2f703900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:28.414 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:28.414+0000 7f2e2f703900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:28.415 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:28.415+0000 7f2e2f703900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:28.542 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:28.542+0000 7f2e2f703900 -1 Falling back to public interface 2026-02-13T05:52:28.617 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T05:52:28.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:52:28.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:52:28.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:52:28.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:52:28.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:52:28.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:52:28.618 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:52:28.619 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:52:28.619 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:52:28.841 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:28.840+0000 7f2e2f703900 -1 osd.3 0 log_to_monitors true 2026-02-13T05:52:28.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:52:29.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:52:29.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:52:29.849 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:52:29.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:52:29.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:52:29.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:52:30.075 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 27 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1314566017,v1:127.0.0.1:6827/1314566017] [v2:127.0.0.1:6828/1314566017,v1:127.0.0.1:6829/1314566017] exists,up c96a6abe-6efb-446a-a3c0-ed0508413389 2026-02-13T05:52:30.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:52:30.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:52:30.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:52:30.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:52:30.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-13T05:52:30.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:52:30.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:52:30.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-13T05:52:30.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:52:30.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-13T05:52:30.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-13T05:52:30.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:52:30.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:52:30.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:52:30.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-13T05:52:30.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-13T05:52:30.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:52:30.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:52:30.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:52:30.081 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:52:30.081 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:52:30.081 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:52:30.081 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:52:30.081 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:30.081 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:30.082 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:30.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:30.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:52:30.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:52:30.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:52:30.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:52:30.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:52:30.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:52:30.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:52:30.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:52:30.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:52:30.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:52:30.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:52:30.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-13T05:52:30.083 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:52:30.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e374fdf1-dbb6-4f71-af89-b84ce847d017 2026-02-13T05:52:30.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 e374fdf1-dbb6-4f71-af89-b84ce847d017' 2026-02-13T05:52:30.083 INFO:tasks.workunit.client.0.trial024.stdout:add osd4 e374fdf1-dbb6-4f71-af89-b84ce847d017 2026-02-13T05:52:30.084 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:52:30.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAevI5pIVR7BRAAJZ8Mi7TCLsiDAe0FrWBv2g== 2026-02-13T05:52:30.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAevI5pIVR7BRAAJZ8Mi7TCLsiDAe0FrWBv2g=="}' 2026-02-13T05:52:30.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e374fdf1-dbb6-4f71-af89-b84ce847d017 -i td/test-erasure-eio/4/new.json 2026-02-13T05:52:30.319 INFO:tasks.workunit.client.0.trial024.stdout:4 2026-02-13T05:52:30.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-13T05:52:30.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAevI5pIVR7BRAAJZ8Mi7TCLsiDAe0FrWBv2g== --osd-uuid e374fdf1-dbb6-4f71-af89-b84ce847d017 2026-02-13T05:52:30.347 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:30.347+0000 7f854740e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:30.349 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:30.348+0000 7f854740e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:30.349 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:30.349+0000 7f854740e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:30.350 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:30.349+0000 7f854740e900 -1 bdev(0x55e6a0f88c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-13T05:52:30.350 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:30.349+0000 7f854740e900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-13T05:52:30.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-13T05:52:30.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:52:30.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-13T05:52:30.699 INFO:tasks.workunit.client.0.trial024.stdout:adding osd4 key to auth repository 2026-02-13T05:52:30.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:52:31.017 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-13T05:52:31.018 INFO:tasks.workunit.client.0.trial024.stdout:start osd.4 2026-02-13T05:52:31.019 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:52:31.019 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:52:31.019 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:52:31.019 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:52:31.036 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:31.035+0000 7fc699729900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:31.037 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:31.037+0000 7fc699729900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:31.038 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:31.038+0000 7fc699729900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:31.171 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:31.170+0000 7fc699729900 -1 Falling back to public interface 2026-02-13T05:52:31.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-13T05:52:31.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:52:31.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-13T05:52:31.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:52:31.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:52:31.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:52:31.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:52:31.244 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:52:31.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:52:31.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:52:31.469 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:31.468+0000 7fc699729900 -1 osd.4 0 log_to_monitors true 2026-02-13T05:52:31.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:52:32.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:52:32.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:52:32.472 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:52:32.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:52:32.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:52:32.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:52:32.697 INFO:tasks.workunit.client.0.trial024.stdout:osd.4 up in weight 1 up_from 36 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1270723860,v1:127.0.0.1:6835/1270723860] [v2:127.0.0.1:6836/1270723860,v1:127.0.0.1:6837/1270723860] exists,up e374fdf1-dbb6-4f71-af89-b84ce847d017 2026-02-13T05:52:32.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:52:32.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:52:32.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:52:32.699 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T05:52:32.699 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:52:32.699 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:52:32.699 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:52:32.699 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:32.699 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:32.699 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:52:32.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T05:52:32.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T05:52:32.745 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:52:32.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T05:52:32.752 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:52:21.071+0000 7fdffc995900 0 load: jerasure load: lrc 2026-02-13T05:52:32.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:540: TEST_ec_backfill_unfound: CEPH_ARGS='--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:52:32.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:542: TEST_ec_backfill_unfound: local poolname=pool-jerasure 2026-02-13T05:52:32.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:543: TEST_ec_backfill_unfound: create_erasure_coded_pool pool-jerasure 3 2 2026-02-13T05:52:32.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:52:32.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T05:52:32.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-13T05:52:32.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T05:52:32.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-13T05:52:32.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T05:52:32.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-13T05:52:33.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T05:52:33.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T05:52:33.431 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T05:52:33.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:52:34.441 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T05:52:34.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:52:34.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:52:34.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:52:34.443 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:52:34.443 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:52:34.443 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:52:34.443 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:52:34.443 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:52:34.444 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:52:34.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:52:34.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:52:34.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:52:34.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:52:34.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:52:34.529 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:52:34.756 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:52:34.756 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:52:34.756 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:52:34.756 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:52:34.756 INFO:tasks.workunit.client.0.trial024.stderr:4' 2026-02-13T05:52:34.756 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:52:34.757 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:52:34.757 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:52:34.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803781 2026-02-13T05:52:34.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803781 2026-02-13T05:52:34.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781' 2026-02-13T05:52:34.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:52:34.822 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:52:34.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574853 2026-02-13T05:52:34.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574853 2026-02-13T05:52:34.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-55834574853' 2026-02-13T05:52:34.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:52:34.888 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:52:34.953 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378629 2026-02-13T05:52:34.953 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378629 2026-02-13T05:52:34.953 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-55834574853 2-81604378629' 2026-02-13T05:52:34.953 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:52:34.953 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:52:35.017 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116996 2026-02-13T05:52:35.018 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116996 2026-02-13T05:52:35.018 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-55834574853 2-81604378629 3-115964116996' 2026-02-13T05:52:35.018 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:52:35.018 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:52:35.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-13T05:52:35.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-13T05:52:35.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-55834574853 2-81604378629 3-115964116996 4-154618822659' 2026-02-13T05:52:35.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:52:35.082 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803781 2026-02-13T05:52:35.082 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:52:35.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:52:35.083 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803781 2026-02-13T05:52:35.083 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:52:35.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803781 2026-02-13T05:52:35.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803781' 2026-02-13T05:52:35.084 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803781 2026-02-13T05:52:35.085 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:52:35.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803781 2026-02-13T05:52:35.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:52:35.312 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574853 2026-02-13T05:52:35.312 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:52:35.313 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:52:35.314 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574853 2026-02-13T05:52:35.314 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:52:35.315 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574853 2026-02-13T05:52:35.315 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574853' 2026-02-13T05:52:35.315 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 55834574853 2026-02-13T05:52:35.315 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:52:35.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574853 -lt 55834574853 2026-02-13T05:52:35.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:52:35.539 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378629 2026-02-13T05:52:35.539 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:52:35.540 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:52:35.540 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378629 2026-02-13T05:52:35.541 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:52:35.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378629 2026-02-13T05:52:35.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378629' 2026-02-13T05:52:35.542 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 81604378629 2026-02-13T05:52:35.542 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:52:35.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378629 -lt 81604378629 2026-02-13T05:52:35.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:52:35.767 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116996 2026-02-13T05:52:35.767 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:52:35.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:52:35.769 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116996 2026-02-13T05:52:35.769 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:52:35.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116996 2026-02-13T05:52:35.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116996' 2026-02-13T05:52:35.771 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 115964116996 2026-02-13T05:52:35.771 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:52:35.998 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116996 -lt 115964116996 2026-02-13T05:52:35.998 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:52:35.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-154618822659 2026-02-13T05:52:35.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:52:35.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:52:36.000 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-154618822659 2026-02-13T05:52:36.000 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:52:36.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822659 2026-02-13T05:52:36.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 154618822659' 2026-02-13T05:52:36.001 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 154618822659 2026-02-13T05:52:36.002 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:52:36.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822657 -lt 154618822659 2026-02-13T05:52:36.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:52:37.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:52:37.225 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:52:37.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-13T05:52:37.451 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:52:37.451 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:52:37.452 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:52:37.765 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:52:37.766 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:52:37.767 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:52:37.767 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:52:37.767 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:52:37.767 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:52:37.767 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:52:37.767 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:52:37.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:52:37.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:52:37.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:52:37.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:52:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:52:38.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:52:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:52:38.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:545: TEST_ec_backfill_unfound: ceph pg dump pgs 2026-02-13T05:52:38.513 INFO:tasks.workunit.client.0.trial024.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T05:52:38.513 INFO:tasks.workunit.client.0.trial024.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:34.043981+0000 0'0 42:13 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-13T05:52:33.370705+0000 0'0 2026-02-13T05:52:33.370705+0000 0 0 periodic scrub scheduled @ 2026-02-14T12:01:03.101606+0000 0 0 2026-02-13T05:52:38.513 INFO:tasks.workunit.client.0.trial024.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:33.171542+0000 0'0 43:20 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T06:04:03.798947+0000 0 0 2026-02-13T05:52:38.513 INFO:tasks.workunit.client.0.trial024.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:33.171395+0000 0'0 42:95 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T13:38:47.845377+0000 0 0 2026-02-13T05:52:38.513 INFO:tasks.workunit.client.0.trial024.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:33.170701+0000 0'0 43:20 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T09:39:24.951137+0000 0 0 2026-02-13T05:52:38.514 INFO:tasks.workunit.client.0.trial024.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:26.961371+0000 0'0 43:65 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T08:12:13.379290+0000 0 0 2026-02-13T05:52:38.514 INFO:tasks.workunit.client.0.trial024.stdout: 2026-02-13T05:52:38.514 INFO:tasks.workunit.client.0.trial024.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T05:52:38.514 INFO:tasks.workunit.client.0.trial024.stderr:dumped pgs 2026-02-13T05:52:38.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:547: TEST_ec_backfill_unfound: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-13T05:52:38.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:52:38.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:52:38.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-13T05:52:38.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:52:38.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:52:38.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:52:38.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:52:38.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:52:38.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:52:38.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:52:38.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:52:38.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:38.541 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:548: TEST_ec_backfill_unfound: get_primary pool-jerasure myobject 2026-02-13T05:52:38.542 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=pool-jerasure 2026-02-13T05:52:38.542 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=myobject 2026-02-13T05:52:38.542 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map pool-jerasure myobject 2026-02-13T05:52:38.542 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-13T05:52:38.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:548: TEST_ec_backfill_unfound: local primary=3 2026-02-13T05:52:38.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:550: TEST_ec_backfill_unfound: get_osds pool-jerasure myobject 2026-02-13T05:52:38.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:52:38.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-13T05:52:38.776 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-13T05:52:38.776 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:52:39.002 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:52:39.003 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:52:39.003 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:52:39.003 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:52:39.003 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:52:39.003 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 4 0 2 2026-02-13T05:52:39.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:550: TEST_ec_backfill_unfound: initial_osds=('3' '1' '4' '0' '2') 2026-02-13T05:52:39.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:550: TEST_ec_backfill_unfound: local -a initial_osds 2026-02-13T05:52:39.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:551: TEST_ec_backfill_unfound: local last_osd=2 2026-02-13T05:52:39.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:552: TEST_ec_backfill_unfound: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-13T05:52:39.003 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:52:39.004 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:52:39.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:52:39.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:52:39.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:52:39.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:52:39.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:553: TEST_ec_backfill_unfound: ceph osd down 2 2026-02-13T05:52:39.337 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 is already down. 2026-02-13T05:52:39.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:554: TEST_ec_backfill_unfound: ceph osd out 2 2026-02-13T05:52:39.634 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 is already out. 2026-02-13T05:52:39.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:556: TEST_ec_backfill_unfound: ceph pg dump pgs 2026-02-13T05:52:39.855 INFO:tasks.workunit.client.0.trial024.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T05:52:39.855 INFO:tasks.workunit.client.0.trial024.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:34.043981+0000 0'0 42:13 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-13T05:52:33.370705+0000 0'0 2026-02-13T05:52:33.370705+0000 0 0 periodic scrub scheduled @ 2026-02-14T12:01:03.101606+0000 0 0 2026-02-13T05:52:39.855 INFO:tasks.workunit.client.0.trial024.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:33.171542+0000 0'0 43:20 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T06:04:03.798947+0000 0 0 2026-02-13T05:52:39.856 INFO:tasks.workunit.client.0.trial024.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:33.171395+0000 0'0 43:97 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T13:38:47.845377+0000 0 0 2026-02-13T05:52:39.856 INFO:tasks.workunit.client.0.trial024.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:33.170701+0000 0'0 43:20 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T09:39:24.951137+0000 0 0 2026-02-13T05:52:39.856 INFO:tasks.workunit.client.0.trial024.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:26.961371+0000 0'0 43:65 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T08:12:13.379290+0000 0 0 2026-02-13T05:52:39.856 INFO:tasks.workunit.client.0.trial024.stdout: 2026-02-13T05:52:39.856 INFO:tasks.workunit.client.0.trial024.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T05:52:39.856 INFO:tasks.workunit.client.0.trial024.stderr:dumped pgs 2026-02-13T05:52:39.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:558: TEST_ec_backfill_unfound: dd if=/dev/urandom of=td/test-erasure-eio/ORIGINAL bs=1024 count=4 2026-02-13T05:52:39.863 INFO:tasks.workunit.client.0.trial024.stderr:4+0 records in 2026-02-13T05:52:39.863 INFO:tasks.workunit.client.0.trial024.stderr:4+0 records out 2026-02-13T05:52:39.864 INFO:tasks.workunit.client.0.trial024.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 6.6063e-05 s, 62.0 MB/s 2026-02-13T05:52:39.864 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: seq 1 300 2026-02-13T05:52:39.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:39.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj1 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:39.885 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:39.885 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj2 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:39.904 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:39.904 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj3 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:39.923 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:39.923 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj4 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:39.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:39.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj5 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:39.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:39.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj6 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:39.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:39.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj7 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:39.997 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:39.997 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj8 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj9 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj10 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj11 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj12 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj13 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.107 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.107 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj14 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj15 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.143 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.143 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj16 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj17 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj18 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj19 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj20 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj21 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj22 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.268 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.268 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj23 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj24 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj25 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj26 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.340 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.340 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj27 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj28 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj29 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj30 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj31 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.430 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.430 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj32 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj33 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.467 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.467 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj34 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj35 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj36 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.520 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.520 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj37 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj38 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj39 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj40 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj41 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj42 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj43 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj44 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj45 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj46 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj47 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj48 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj49 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj50 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj51 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj52 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.809 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj53 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj54 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj55 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj56 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj57 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj58 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.918 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.918 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj59 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj60 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.954 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.954 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj61 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj62 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:40.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:40.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj63 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj64 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj65 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj66 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj67 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj68 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj69 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj70 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj71 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.155 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj72 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj73 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj74 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj75 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj76 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj77 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj78 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj79 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj80 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj81 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj82 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj83 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj84 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.390 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.390 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj85 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj86 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj87 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj88 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj89 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj90 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj91 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj92 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj93 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj94 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj95 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj96 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj97 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj98 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj99 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj100 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj101 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj102 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj103 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj104 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj105 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj106 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj107 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.809 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.809 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj108 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj109 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj110 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.863 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.863 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj111 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj112 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj113 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj114 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj115 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj116 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj117 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:41.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:41.993 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj118 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj119 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.030 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.030 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj120 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj121 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj122 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.086 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.086 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj123 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.106 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.106 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj124 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj125 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.143 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.143 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj126 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.161 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.161 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj127 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj128 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj129 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.216 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.216 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj130 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj131 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.254 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.254 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj132 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj133 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj134 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj135 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj136 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj137 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.365 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.365 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj138 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj139 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj140 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj141 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj142 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.457 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.457 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj143 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.476 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.476 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj144 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj145 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj146 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj147 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj148 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj149 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj150 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj151 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj152 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj153 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj154 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.679 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.679 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj155 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj156 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj157 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.734 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj158 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj159 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.771 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.771 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj160 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj161 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.808 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.808 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj162 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj163 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj164 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj165 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj166 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj167 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.920 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.920 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj168 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj169 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj170 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj171 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:42.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:42.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj172 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj173 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj174 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.050 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj175 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.069 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.069 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj176 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj177 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.107 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.107 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj178 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj179 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.144 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.144 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj180 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj181 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj182 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj183 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj184 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj185 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj186 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj187 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj188 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj189 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.332 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.332 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj190 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.350 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.350 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj191 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj192 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj193 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj194 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj195 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.443 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.443 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj196 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj197 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj198 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.499 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.499 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj199 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj200 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj201 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj202 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj203 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.591 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.591 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj204 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj205 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj206 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj207 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj208 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj209 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.701 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj210 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.721 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.721 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj211 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.742 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.742 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj212 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj213 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj214 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj215 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj216 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.833 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.833 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj217 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj218 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.872 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.872 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj219 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.891 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.891 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj220 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.909 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.909 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj221 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.928 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.928 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj222 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj223 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj224 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:43.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:43.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj225 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj226 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj227 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj228 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj229 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj230 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj231 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj232 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj233 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj234 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.173 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.173 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj235 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj236 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.211 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.211 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj237 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj238 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj239 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj240 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj241 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj242 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj243 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj244 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj245 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj246 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj247 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj248 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj249 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.455 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj250 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj251 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.493 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj252 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.511 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.511 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj253 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj254 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj255 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj256 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj257 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj258 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj259 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj260 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj261 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj262 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj263 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj264 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj265 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj266 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj267 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj268 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj269 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj270 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj271 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj272 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.886 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.886 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj273 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.905 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.905 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj274 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj275 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj276 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj277 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:44.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:44.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj278 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj279 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.020 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.020 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj280 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj281 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj282 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj283 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj284 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj285 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj286 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.153 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.153 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj287 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj288 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj289 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.208 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.208 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj290 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj291 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj292 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj293 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj294 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj295 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj296 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.340 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.340 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj297 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj298 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj299 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:559: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:52:45.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:561: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj300 td/test-erasure-eio/ORIGINAL 2026-02-13T05:52:45.417 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:564: TEST_ec_backfill_unfound: inject_eio ec data pool-jerasure obj250 td/test-erasure-eio 0 2026-02-13T05:52:45.417 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T05:52:45.417 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T05:52:45.417 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T05:52:45.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T05:52:45.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T05:52:45.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T05:52:45.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj250 2026-02-13T05:52:45.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T05:52:45.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T05:52:45.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T05:52:45.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-13T05:52:45.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T05:52:45.418 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj250 2026-02-13T05:52:45.418 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:52:45.418 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj250 2026-02-13T05:52:45.419 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj250 2026-02-13T05:52:45.419 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:52:45.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:52:45.642 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:52:45.643 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:52:45.643 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:52:45.643 INFO:tasks.workunit.client.0.trial024.stderr:2147483647' 2026-02-13T05:52:45.643 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 4 0 2147483647 2026-02-13T05:52:45.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '4' '0' '2147483647') 2026-02-13T05:52:45.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T05:52:45.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-13T05:52:45.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T05:52:45.643 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-13T05:52:45.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T05:52:45.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-13T05:52:45.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T05:52:45.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-13T05:52:45.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T05:52:45.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T05:52:45.646 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T05:52:45.646 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-13T05:52:45.646 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T05:52:45.646 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T05:52:45.646 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:52:45.646 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:45.646 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:45.646 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T05:52:45.646 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-13T05:52:45.694 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T05:52:45.694 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T05:52:45.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T05:52:45.695 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-13T05:52:45.695 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T05:52:45.695 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T05:52:45.696 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:52:45.696 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:45.696 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:45.696 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T05:52:45.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T05:52:45.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.3.asok injectdataerr pool-jerasure obj250 0 2026-02-13T05:52:45.746 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:565: TEST_ec_backfill_unfound: inject_eio ec data pool-jerasure obj250 td/test-erasure-eio 1 2026-02-13T05:52:45.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T05:52:45.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T05:52:45.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T05:52:45.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T05:52:45.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T05:52:45.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T05:52:45.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj250 2026-02-13T05:52:45.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T05:52:45.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T05:52:45.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T05:52:45.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=1 2026-02-13T05:52:45.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T05:52:45.748 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj250 2026-02-13T05:52:45.748 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:52:45.748 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj250 2026-02-13T05:52:45.748 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj250 2026-02-13T05:52:45.748 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:52:45.973 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:52:45.973 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:52:45.974 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:52:45.974 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:52:45.974 INFO:tasks.workunit.client.0.trial024.stderr:2147483647' 2026-02-13T05:52:45.974 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 4 0 2147483647 2026-02-13T05:52:45.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '4' '0' '2147483647') 2026-02-13T05:52:45.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T05:52:45.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-13T05:52:45.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T05:52:45.974 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/1/type 2026-02-13T05:52:45.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T05:52:45.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-13T05:52:45.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T05:52:45.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-13T05:52:45.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T05:52:45.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T05:52:45.977 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T05:52:45.977 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-13T05:52:45.977 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T05:52:45.977 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T05:52:45.977 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:52:45.977 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:45.977 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:45.977 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.1.asok 2026-02-13T05:52:45.977 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-13T05:52:46.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T05:52:46.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T05:52:46.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T05:52:46.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-13T05:52:46.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T05:52:46.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T05:52:46.026 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:52:46.026 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:46.027 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:46.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.1.asok 2026-02-13T05:52:46.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T05:52:46.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.1.asok injectdataerr pool-jerasure obj250 1 2026-02-13T05:52:46.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:567: TEST_ec_backfill_unfound: activate_osd td/test-erasure-eio 2 2026-02-13T05:52:46.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:52:46.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:52:46.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T05:52:46.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:52:46.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:52:46.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:52:46.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:52:46.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:52:46.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:46.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:52:46.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:52:46.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:52:46.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:52:46.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:52:46.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:52:46.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:52:46.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:52:46.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:52:46.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:52:46.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:52:46.082 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:52:46.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T05:52:46.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:52:46.083 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-13T05:52:46.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T05:52:46.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:52:46.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:52:46.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:52:46.094 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:46.093+0000 7ff6ec9e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:46.095 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:46.095+0000 7ff6ec9e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:46.096 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:46.096+0000 7ff6ec9e0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:52:46.220 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:46.219+0000 7ff6ec9e0900 -1 Falling back to public interface 2026-02-13T05:52:46.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T05:52:46.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:52:46.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:52:46.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:52:46.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:52:46.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:52:46.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:52:46.304 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:52:46.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:52:46.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:52:46.529 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:52:46.529+0000 7ff6ec9e0900 -1 osd.2 43 log_to_monitors true 2026-02-13T05:52:46.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:52:47.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:52:47.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:52:47.534 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:52:47.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:52:47.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:52:47.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:52:47.761 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up out weight 0 up_from 49 up_thru 19 down_at 44 last_clean_interval [19,43) [v2:127.0.0.1:6818/1815536722,v1:127.0.0.1:6819/1815536722] [v2:127.0.0.1:6820/1815536722,v1:127.0.0.1:6821/1815536722] exists,up 0a89b4df-0567-4e89-9dcf-6514dfbc7a55 2026-02-13T05:52:47.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:52:47.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:52:47.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:52:47.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:568: TEST_ec_backfill_unfound: ceph osd in 2 2026-02-13T05:52:48.012 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 is already in. 2026-02-13T05:52:48.021 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:570: TEST_ec_backfill_unfound: sleep 15 2026-02-13T05:53:03.023 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:572: TEST_ec_backfill_unfound: seq 1 240 2026-02-13T05:53:03.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:572: TEST_ec_backfill_unfound: for tmp in $(seq 1 240) 2026-02-13T05:53:03.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:573: TEST_ec_backfill_unfound: get_state 2.0 2026-02-13T05:53:03.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:60: get_state: local pgid=2.0 2026-02-13T05:53:03.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:61: get_state: local sname=state 2026-02-13T05:53:03.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:62: get_state: ceph --format json pg dump pgs 2026-02-13T05:53:03.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:63: get_state: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .state' 2026-02-13T05:53:03.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:573: TEST_ec_backfill_unfound: state=active+backfill_unfound+undersized+degraded+remapped 2026-02-13T05:53:03.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:574: TEST_ec_backfill_unfound: echo active+backfill_unfound+undersized+degraded+remapped 2026-02-13T05:53:03.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:574: TEST_ec_backfill_unfound: grep backfill_unfound 2026-02-13T05:53:03.247 INFO:tasks.workunit.client.0.trial024.stdout:active+backfill_unfound+undersized+degraded+remapped 2026-02-13T05:53:03.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:575: TEST_ec_backfill_unfound: '[' 0 = 0 ']' 2026-02-13T05:53:03.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:576: TEST_ec_backfill_unfound: break 2026-02-13T05:53:03.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:582: TEST_ec_backfill_unfound: ceph pg dump pgs 2026-02-13T05:53:03.462 INFO:tasks.workunit.client.0.trial024.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T05:53:03.462 INFO:tasks.workunit.client.0.trial024.stdout:2.0 301 1 28 0 1 1232896 0 0 101 200 101 active+backfill_unfound+undersized+degraded+remapped 2026-02-13T05:52:48.811231+0000 47'301 55:907 [3,1,4,0,2] 3 [3,1,4,0,NONE] 3 0'0 2026-02-13T05:52:33.370705+0000 0'0 2026-02-13T05:52:33.370705+0000 0 0 no scrub is scheduled 0 0 2026-02-13T05:53:03.462 INFO:tasks.workunit.client.0.trial024.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:48.051906+0000 0'0 55:62 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T08:59:10.968696+0000 0 0 2026-02-13T05:53:03.463 INFO:tasks.workunit.client.0.trial024.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:33.171395+0000 0'0 55:120 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T13:38:47.845377+0000 0 0 2026-02-13T05:53:03.463 INFO:tasks.workunit.client.0.trial024.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:33.170701+0000 0'0 55:44 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T09:39:24.951137+0000 0 0 2026-02-13T05:53:03.463 INFO:tasks.workunit.client.0.trial024.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:48.051891+0000 0'0 55:107 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T10:02:32.566806+0000 0 0 2026-02-13T05:53:03.463 INFO:tasks.workunit.client.0.trial024.stdout: 2026-02-13T05:53:03.463 INFO:tasks.workunit.client.0.trial024.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T05:53:03.463 INFO:tasks.workunit.client.0.trial024.stderr:dumped pgs 2026-02-13T05:53:03.469 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:583: TEST_ec_backfill_unfound: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-13T05:53:03.470 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:53:03.470 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:53:03.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:53:03.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:53:03.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:53:03.575 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:53:03.575 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:584: TEST_ec_backfill_unfound: sleep 5 2026-02-13T05:53:08.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:586: TEST_ec_backfill_unfound: ceph pg dump pgs 2026-02-13T05:53:08.791 INFO:tasks.workunit.client.0.trial024.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T05:53:08.792 INFO:tasks.workunit.client.0.trial024.stdout:2.0 301 1 303 0 1 1232896 0 0 101 200 101 active+recovery_unfound+undersized+degraded 2026-02-13T05:53:03.630670+0000 47'301 57:919 [3,1,4,0,NONE] 3 [3,1,4,0,NONE] 3 0'0 2026-02-13T05:52:33.370705+0000 0'0 2026-02-13T05:52:33.370705+0000 0 0 no scrub is scheduled 0 0 2026-02-13T05:53:08.792 INFO:tasks.workunit.client.0.trial024.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:48.051906+0000 0'0 55:62 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T08:59:10.968696+0000 0 0 2026-02-13T05:53:08.792 INFO:tasks.workunit.client.0.trial024.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:33.171395+0000 0'0 55:120 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T13:38:47.845377+0000 0 0 2026-02-13T05:53:08.792 INFO:tasks.workunit.client.0.trial024.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:52:33.170701+0000 0'0 55:44 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T09:39:24.951137+0000 0 0 2026-02-13T05:53:08.792 INFO:tasks.workunit.client.0.trial024.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+undersized 2026-02-13T05:53:03.628724+0000 0'0 57:115 [1,0] 1 [1,0] 1 0'0 2026-02-13T05:52:19.103151+0000 0'0 2026-02-13T05:52:19.103151+0000 0 0 periodic scrub scheduled @ 2026-02-14T14:20:01.953544+0000 0 0 2026-02-13T05:53:08.792 INFO:tasks.workunit.client.0.trial024.stdout: 2026-02-13T05:53:08.792 INFO:tasks.workunit.client.0.trial024.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T05:53:08.793 INFO:tasks.workunit.client.0.trial024.stderr:dumped pgs 2026-02-13T05:53:08.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:587: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-13T05:53:08.862 INFO:tasks.workunit.client.0.trial024.stdout:{ 2026-02-13T05:53:08.862 INFO:tasks.workunit.client.0.trial024.stdout: "num_missing": 1, 2026-02-13T05:53:08.862 INFO:tasks.workunit.client.0.trial024.stdout: "num_unfound": 1, 2026-02-13T05:53:08.862 INFO:tasks.workunit.client.0.trial024.stdout: "objects": [ 2026-02-13T05:53:08.862 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.862 INFO:tasks.workunit.client.0.trial024.stdout: "oid": { 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: "oid": "obj250", 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: "key": "", 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: "snapid": -2, 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: "hash": 2249616407, 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: "max": 0, 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: "pool": 2, 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: "namespace": "" 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: "need": "47'251", 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: "have": "0'0", 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: "flags": "none", 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: "clean_regions": "clean_offsets: [], clean_omap: false, new_object: true", 2026-02-13T05:53:08.863 INFO:tasks.workunit.client.0.trial024.stdout: "locations": [ 2026-02-13T05:53:08.864 INFO:tasks.workunit.client.0.trial024.stdout: "0(3)", 2026-02-13T05:53:08.864 INFO:tasks.workunit.client.0.trial024.stdout: "4(2)" 2026-02-13T05:53:08.864 INFO:tasks.workunit.client.0.trial024.stdout: ] 2026-02-13T05:53:08.864 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.864 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.864 INFO:tasks.workunit.client.0.trial024.stdout: "state": "NotRecovering", 2026-02-13T05:53:08.864 INFO:tasks.workunit.client.0.trial024.stdout: "available_might_have_unfound": true, 2026-02-13T05:53:08.864 INFO:tasks.workunit.client.0.trial024.stdout: "might_have_unfound": [ 2026-02-13T05:53:08.864 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.864 INFO:tasks.workunit.client.0.trial024.stdout: "osd": "2(4)", 2026-02-13T05:53:08.864 INFO:tasks.workunit.client.0.trial024.stdout: "status": "osd is down" 2026-02-13T05:53:08.864 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.865 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.865 INFO:tasks.workunit.client.0.trial024.stdout: "more": false 2026-02-13T05:53:08.865 INFO:tasks.workunit.client.0.trial024.stdout:} 2026-02-13T05:53:08.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:588: TEST_ec_backfill_unfound: ceph pg 2.0 query 2026-02-13T05:53:08.929 INFO:tasks.workunit.client.0.trial024.stdout:{ 2026-02-13T05:53:08.930 INFO:tasks.workunit.client.0.trial024.stdout: "snap_trimq": "[]", 2026-02-13T05:53:08.930 INFO:tasks.workunit.client.0.trial024.stdout: "snap_trimq_len": 0, 2026-02-13T05:53:08.930 INFO:tasks.workunit.client.0.trial024.stdout: "state": "active+recovery_unfound+undersized+degraded", 2026-02-13T05:53:08.930 INFO:tasks.workunit.client.0.trial024.stdout: "epoch": 57, 2026-02-13T05:53:08.930 INFO:tasks.workunit.client.0.trial024.stdout: "up": [ 2026-02-13T05:53:08.930 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:53:08.930 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:53:08.930 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:53:08.930 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:53:08.930 INFO:tasks.workunit.client.0.trial024.stdout: 2147483647 2026-02-13T05:53:08.931 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.931 INFO:tasks.workunit.client.0.trial024.stdout: "acting": [ 2026-02-13T05:53:08.931 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:53:08.931 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:53:08.931 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:53:08.931 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:53:08.931 INFO:tasks.workunit.client.0.trial024.stdout: 2147483647 2026-02-13T05:53:08.931 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.931 INFO:tasks.workunit.client.0.trial024.stdout: "acting_recovery_backfill": [ 2026-02-13T05:53:08.931 INFO:tasks.workunit.client.0.trial024.stdout: "0(3)", 2026-02-13T05:53:08.931 INFO:tasks.workunit.client.0.trial024.stdout: "1(1)", 2026-02-13T05:53:08.931 INFO:tasks.workunit.client.0.trial024.stdout: "3(0)", 2026-02-13T05:53:08.932 INFO:tasks.workunit.client.0.trial024.stdout: "4(2)" 2026-02-13T05:53:08.932 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.932 INFO:tasks.workunit.client.0.trial024.stdout: "info": { 2026-02-13T05:53:08.932 INFO:tasks.workunit.client.0.trial024.stdout: "pgid": "2.0s0", 2026-02-13T05:53:08.932 INFO:tasks.workunit.client.0.trial024.stdout: "shard": "0", 2026-02-13T05:53:08.932 INFO:tasks.workunit.client.0.trial024.stdout: "last_update": "47'301", 2026-02-13T05:53:08.932 INFO:tasks.workunit.client.0.trial024.stdout: "last_complete": "47'250", 2026-02-13T05:53:08.932 INFO:tasks.workunit.client.0.trial024.stdout: "log_tail": "47'200", 2026-02-13T05:53:08.932 INFO:tasks.workunit.client.0.trial024.stdout: "last_user_version": 301, 2026-02-13T05:53:08.932 INFO:tasks.workunit.client.0.trial024.stdout: "last_backfill": "MAX", 2026-02-13T05:53:08.932 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete": [], 2026-02-13T05:53:08.932 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete_epoch": "56", 2026-02-13T05:53:08.933 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [], 2026-02-13T05:53:08.933 INFO:tasks.workunit.client.0.trial024.stdout: "history": { 2026-02-13T05:53:08.933 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_created": 41, 2026-02-13T05:53:08.933 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_pool_created": 41, 2026-02-13T05:53:08.933 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 57, 2026-02-13T05:53:08.933 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_started": 56, 2026-02-13T05:53:08.933 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 42, 2026-02-13T05:53:08.933 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_clean": 41, 2026-02-13T05:53:08.933 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_split": 0, 2026-02-13T05:53:08.933 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_marked_full": 0, 2026-02-13T05:53:08.933 INFO:tasks.workunit.client.0.trial024.stdout: "same_up_since": 56, 2026-02-13T05:53:08.933 INFO:tasks.workunit.client.0.trial024.stdout: "same_interval_since": 56, 2026-02-13T05:53:08.934 INFO:tasks.workunit.client.0.trial024.stdout: "same_primary_since": 41, 2026-02-13T05:53:08.934 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:53:08.934 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.934 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:53:08.934 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.934 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.934 INFO:tasks.workunit.client.0.trial024.stdout: "prior_readable_until_ub": 0 2026-02-13T05:53:08.934 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.934 INFO:tasks.workunit.client.0.trial024.stdout: "stats": { 2026-02-13T05:53:08.934 INFO:tasks.workunit.client.0.trial024.stdout: "version": "47'301", 2026-02-13T05:53:08.934 INFO:tasks.workunit.client.0.trial024.stdout: "reported_seq": 920, 2026-02-13T05:53:08.934 INFO:tasks.workunit.client.0.trial024.stdout: "reported_epoch": 57, 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "state": "active+recovery_unfound+undersized+degraded", 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "last_fresh": "2026-02-13T05:53:03.630670+0000", 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "last_change": "2026-02-13T05:53:03.630670+0000", 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "last_active": "2026-02-13T05:53:03.630670+0000", 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "last_peered": "2026-02-13T05:53:03.630670+0000", 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean": "2026-02-13T05:52:38.539792+0000", 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_active": "2026-02-13T05:53:03.628898+0000", 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_peered": "2026-02-13T05:53:03.628898+0000", 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "last_unstale": "2026-02-13T05:53:03.630670+0000", 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "last_undegraded": "2026-02-13T05:53:03.627598+0000", 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "last_fullsized": "2026-02-13T05:53:03.627498+0000", 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "mapping_epoch": 56, 2026-02-13T05:53:08.935 INFO:tasks.workunit.client.0.trial024.stdout: "log_start": "47'200", 2026-02-13T05:53:08.936 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_start": "47'200", 2026-02-13T05:53:08.936 INFO:tasks.workunit.client.0.trial024.stdout: "created": 41, 2026-02-13T05:53:08.936 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 42, 2026-02-13T05:53:08.936 INFO:tasks.workunit.client.0.trial024.stdout: "parent": "0.0", 2026-02-13T05:53:08.936 INFO:tasks.workunit.client.0.trial024.stdout: "parent_split_bits": 0, 2026-02-13T05:53:08.936 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:53:08.936 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.936 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:53:08.936 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.936 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.936 INFO:tasks.workunit.client.0.trial024.stdout: "objects_scrubbed": 0, 2026-02-13T05:53:08.936 INFO:tasks.workunit.client.0.trial024.stdout: "log_size": 101, 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "log_dups_size": 200, 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_size": 101, 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "stats_invalid": false, 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "dirty_stats_invalid": false, 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "omap_stats_invalid": false, 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_stats_invalid": false, 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_bytes_stats_invalid": false, 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "pin_stats_invalid": false, 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "manifest_stats_invalid": false, 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrimq_len": 0, 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_duration": 0, 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_schedule": "no scrub is scheduled", 2026-02-13T05:53:08.937 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_duration": 0, 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "objects_trimmed": 0, 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrim_duration": 0, 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "stat_sum": { 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes": 1232896, 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects": 301, 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_clones": 0, 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_copies": 1505, 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing_on_primary": 1, 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing": 1, 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_degraded": 303, 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_misplaced": 0, 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_unfound": 1, 2026-02-13T05:53:08.938 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_dirty": 301, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_whiteouts": 0, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_read": 0, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_read_kb": 0, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_write": 301, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_write_kb": 1204, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_scrub_errors": 0, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_deep_scrub_errors": 0, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_recovered": 0, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_recovered": 0, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_keys_recovered": 0, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_omap": 0, 2026-02-13T05:53:08.939 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_kb": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_kb": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_promote": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_high": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_low": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_some": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_full": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_pinned": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_legacy_snapsets": 0, 2026-02-13T05:53:08.940 INFO:tasks.workunit.client.0.trial024.stdout: "num_large_omap_objects": 0, 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_manifest": 0, 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_bytes": 0, 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_keys": 0, 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_repaired": 0 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: "up": [ 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: 2147483647 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.941 INFO:tasks.workunit.client.0.trial024.stdout: "acting": [ 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: 2147483647 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: "avail_no_missing": [ 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: "0(3)", 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: "4(2)" 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: "object_location_counts": [ 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.942 INFO:tasks.workunit.client.0.trial024.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: "objects": 300 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: "shards": "0(3),4(2)", 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: "objects": 1 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: "blocked_by": [], 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: "up_primary": 3, 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: "acting_primary": 3, 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [] 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.943 INFO:tasks.workunit.client.0.trial024.stdout: "empty": 0, 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: "dne": 0, 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: "incomplete": 0, 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 57, 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: "hit_set_history": { 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: "current_last_update": "0'0", 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: "history": [] 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: "peer_info": [ 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: "peer": "0(3)", 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: "pgid": "2.0s3", 2026-02-13T05:53:08.944 INFO:tasks.workunit.client.0.trial024.stdout: "shard": "3", 2026-02-13T05:53:08.945 INFO:tasks.workunit.client.0.trial024.stdout: "last_update": "47'301", 2026-02-13T05:53:08.945 INFO:tasks.workunit.client.0.trial024.stdout: "last_complete": "47'301", 2026-02-13T05:53:08.945 INFO:tasks.workunit.client.0.trial024.stdout: "log_tail": "47'200", 2026-02-13T05:53:08.945 INFO:tasks.workunit.client.0.trial024.stdout: "last_user_version": 301, 2026-02-13T05:53:08.945 INFO:tasks.workunit.client.0.trial024.stdout: "last_backfill": "MAX", 2026-02-13T05:53:08.945 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete": [], 2026-02-13T05:53:08.945 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-13T05:53:08.945 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [], 2026-02-13T05:53:08.945 INFO:tasks.workunit.client.0.trial024.stdout: "history": { 2026-02-13T05:53:08.945 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_created": 41, 2026-02-13T05:53:08.945 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_pool_created": 41, 2026-02-13T05:53:08.945 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 57, 2026-02-13T05:53:08.946 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_started": 56, 2026-02-13T05:53:08.946 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 42, 2026-02-13T05:53:08.946 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_clean": 41, 2026-02-13T05:53:08.946 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_split": 0, 2026-02-13T05:53:08.946 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_marked_full": 0, 2026-02-13T05:53:08.947 INFO:tasks.workunit.client.0.trial024.stdout: "same_up_since": 56, 2026-02-13T05:53:08.947 INFO:tasks.workunit.client.0.trial024.stdout: "same_interval_since": 56, 2026-02-13T05:53:08.947 INFO:tasks.workunit.client.0.trial024.stdout: "same_primary_since": 41, 2026-02-13T05:53:08.947 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:53:08.947 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.947 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:53:08.947 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.947 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.947 INFO:tasks.workunit.client.0.trial024.stdout: "prior_readable_until_ub": 0 2026-02-13T05:53:08.947 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.947 INFO:tasks.workunit.client.0.trial024.stdout: "stats": { 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "version": "47'301", 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "reported_seq": 910, 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "reported_epoch": 56, 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "state": "active+undersized+degraded", 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "last_fresh": "2026-02-13T05:52:45.415253+0000", 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "last_change": "2026-02-13T05:52:39.160593+0000", 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "last_active": "2026-02-13T05:52:45.415253+0000", 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "last_peered": "2026-02-13T05:52:45.415253+0000", 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean": "2026-02-13T05:52:38.539792+0000", 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_active": "2026-02-13T05:52:39.160593+0000", 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_peered": "2026-02-13T05:52:39.160593+0000", 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "last_unstale": "2026-02-13T05:52:45.415253+0000", 2026-02-13T05:53:08.948 INFO:tasks.workunit.client.0.trial024.stdout: "last_undegraded": "2026-02-13T05:52:39.159290+0000", 2026-02-13T05:53:08.949 INFO:tasks.workunit.client.0.trial024.stdout: "last_fullsized": "2026-02-13T05:52:39.159192+0000", 2026-02-13T05:53:08.949 INFO:tasks.workunit.client.0.trial024.stdout: "mapping_epoch": 56, 2026-02-13T05:53:08.949 INFO:tasks.workunit.client.0.trial024.stdout: "log_start": "47'200", 2026-02-13T05:53:08.949 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_start": "47'200", 2026-02-13T05:53:08.949 INFO:tasks.workunit.client.0.trial024.stdout: "created": 41, 2026-02-13T05:53:08.949 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 42, 2026-02-13T05:53:08.949 INFO:tasks.workunit.client.0.trial024.stdout: "parent": "0.0", 2026-02-13T05:53:08.949 INFO:tasks.workunit.client.0.trial024.stdout: "parent_split_bits": 0, 2026-02-13T05:53:08.949 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:53:08.949 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.949 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:53:08.949 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.950 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.950 INFO:tasks.workunit.client.0.trial024.stdout: "objects_scrubbed": 0, 2026-02-13T05:53:08.950 INFO:tasks.workunit.client.0.trial024.stdout: "log_size": 101, 2026-02-13T05:53:08.950 INFO:tasks.workunit.client.0.trial024.stdout: "log_dups_size": 200, 2026-02-13T05:53:08.950 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_size": 101, 2026-02-13T05:53:08.950 INFO:tasks.workunit.client.0.trial024.stdout: "stats_invalid": false, 2026-02-13T05:53:08.950 INFO:tasks.workunit.client.0.trial024.stdout: "dirty_stats_invalid": false, 2026-02-13T05:53:08.950 INFO:tasks.workunit.client.0.trial024.stdout: "omap_stats_invalid": false, 2026-02-13T05:53:08.950 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_stats_invalid": false, 2026-02-13T05:53:08.950 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_bytes_stats_invalid": false, 2026-02-13T05:53:08.950 INFO:tasks.workunit.client.0.trial024.stdout: "pin_stats_invalid": false, 2026-02-13T05:53:08.950 INFO:tasks.workunit.client.0.trial024.stdout: "manifest_stats_invalid": false, 2026-02-13T05:53:08.951 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrimq_len": 0, 2026-02-13T05:53:08.951 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_duration": 0, 2026-02-13T05:53:08.951 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-14T12:42:43.601462+0000", 2026-02-13T05:53:08.951 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_duration": 0, 2026-02-13T05:53:08.951 INFO:tasks.workunit.client.0.trial024.stdout: "objects_trimmed": 0, 2026-02-13T05:53:08.951 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrim_duration": 0, 2026-02-13T05:53:08.951 INFO:tasks.workunit.client.0.trial024.stdout: "stat_sum": { 2026-02-13T05:53:08.951 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes": 1232896, 2026-02-13T05:53:08.951 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects": 301, 2026-02-13T05:53:08.951 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_clones": 0, 2026-02-13T05:53:08.951 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_copies": 1505, 2026-02-13T05:53:08.951 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T05:53:08.952 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing": 0, 2026-02-13T05:53:08.952 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_degraded": 301, 2026-02-13T05:53:08.952 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_misplaced": 0, 2026-02-13T05:53:08.952 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_unfound": 0, 2026-02-13T05:53:08.952 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_dirty": 301, 2026-02-13T05:53:08.952 INFO:tasks.workunit.client.0.trial024.stdout: "num_whiteouts": 0, 2026-02-13T05:53:08.952 INFO:tasks.workunit.client.0.trial024.stdout: "num_read": 0, 2026-02-13T05:53:08.952 INFO:tasks.workunit.client.0.trial024.stdout: "num_read_kb": 0, 2026-02-13T05:53:08.952 INFO:tasks.workunit.client.0.trial024.stdout: "num_write": 301, 2026-02-13T05:53:08.952 INFO:tasks.workunit.client.0.trial024.stdout: "num_write_kb": 1204, 2026-02-13T05:53:08.952 INFO:tasks.workunit.client.0.trial024.stdout: "num_scrub_errors": 0, 2026-02-13T05:53:08.952 INFO:tasks.workunit.client.0.trial024.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T05:53:08.953 INFO:tasks.workunit.client.0.trial024.stdout: "num_deep_scrub_errors": 0, 2026-02-13T05:53:08.953 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_recovered": 0, 2026-02-13T05:53:08.953 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_recovered": 0, 2026-02-13T05:53:08.953 INFO:tasks.workunit.client.0.trial024.stdout: "num_keys_recovered": 0, 2026-02-13T05:53:08.953 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_omap": 0, 2026-02-13T05:53:08.953 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T05:53:08.953 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T05:53:08.953 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush": 0, 2026-02-13T05:53:08.953 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_kb": 0, 2026-02-13T05:53:08.953 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict": 0, 2026-02-13T05:53:08.953 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_kb": 0, 2026-02-13T05:53:08.953 INFO:tasks.workunit.client.0.trial024.stdout: "num_promote": 0, 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_high": 0, 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_low": 0, 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_some": 0, 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_full": 0, 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_pinned": 0, 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: "num_legacy_snapsets": 0, 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: "num_large_omap_objects": 0, 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_manifest": 0, 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_bytes": 0, 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_keys": 0, 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_repaired": 0 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.954 INFO:tasks.workunit.client.0.trial024.stdout: "up": [ 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: 2147483647 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: "acting": [ 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: 2147483647 2026-02-13T05:53:08.955 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.956 INFO:tasks.workunit.client.0.trial024.stdout: "avail_no_missing": [ 2026-02-13T05:53:08.956 INFO:tasks.workunit.client.0.trial024.stdout: "3(0)", 2026-02-13T05:53:08.956 INFO:tasks.workunit.client.0.trial024.stdout: "0(3)", 2026-02-13T05:53:08.956 INFO:tasks.workunit.client.0.trial024.stdout: "1(1)", 2026-02-13T05:53:08.956 INFO:tasks.workunit.client.0.trial024.stdout: "4(2)" 2026-02-13T05:53:08.956 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.956 INFO:tasks.workunit.client.0.trial024.stdout: "object_location_counts": [ 2026-02-13T05:53:08.956 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.956 INFO:tasks.workunit.client.0.trial024.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-13T05:53:08.956 INFO:tasks.workunit.client.0.trial024.stdout: "objects": 301 2026-02-13T05:53:08.956 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.956 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.957 INFO:tasks.workunit.client.0.trial024.stdout: "blocked_by": [], 2026-02-13T05:53:08.957 INFO:tasks.workunit.client.0.trial024.stdout: "up_primary": 3, 2026-02-13T05:53:08.957 INFO:tasks.workunit.client.0.trial024.stdout: "acting_primary": 3, 2026-02-13T05:53:08.957 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [] 2026-02-13T05:53:08.957 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.957 INFO:tasks.workunit.client.0.trial024.stdout: "empty": 0, 2026-02-13T05:53:08.957 INFO:tasks.workunit.client.0.trial024.stdout: "dne": 0, 2026-02-13T05:53:08.957 INFO:tasks.workunit.client.0.trial024.stdout: "incomplete": 0, 2026-02-13T05:53:08.957 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 57, 2026-02-13T05:53:08.957 INFO:tasks.workunit.client.0.trial024.stdout: "hit_set_history": { 2026-02-13T05:53:08.957 INFO:tasks.workunit.client.0.trial024.stdout: "current_last_update": "0'0", 2026-02-13T05:53:08.958 INFO:tasks.workunit.client.0.trial024.stdout: "history": [] 2026-02-13T05:53:08.958 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.958 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.958 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.958 INFO:tasks.workunit.client.0.trial024.stdout: "peer": "1(1)", 2026-02-13T05:53:08.958 INFO:tasks.workunit.client.0.trial024.stdout: "pgid": "2.0s1", 2026-02-13T05:53:08.958 INFO:tasks.workunit.client.0.trial024.stdout: "shard": "1", 2026-02-13T05:53:08.958 INFO:tasks.workunit.client.0.trial024.stdout: "last_update": "47'301", 2026-02-13T05:53:08.958 INFO:tasks.workunit.client.0.trial024.stdout: "last_complete": "47'301", 2026-02-13T05:53:08.958 INFO:tasks.workunit.client.0.trial024.stdout: "log_tail": "47'200", 2026-02-13T05:53:08.958 INFO:tasks.workunit.client.0.trial024.stdout: "last_user_version": 301, 2026-02-13T05:53:08.958 INFO:tasks.workunit.client.0.trial024.stdout: "last_backfill": "MAX", 2026-02-13T05:53:08.959 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete": [], 2026-02-13T05:53:08.959 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-13T05:53:08.959 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [], 2026-02-13T05:53:08.959 INFO:tasks.workunit.client.0.trial024.stdout: "history": { 2026-02-13T05:53:08.959 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_created": 41, 2026-02-13T05:53:08.959 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_pool_created": 41, 2026-02-13T05:53:08.959 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 57, 2026-02-13T05:53:08.959 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_started": 56, 2026-02-13T05:53:08.959 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 42, 2026-02-13T05:53:08.959 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_clean": 41, 2026-02-13T05:53:08.959 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_split": 0, 2026-02-13T05:53:08.959 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_marked_full": 0, 2026-02-13T05:53:08.960 INFO:tasks.workunit.client.0.trial024.stdout: "same_up_since": 56, 2026-02-13T05:53:08.960 INFO:tasks.workunit.client.0.trial024.stdout: "same_interval_since": 56, 2026-02-13T05:53:08.960 INFO:tasks.workunit.client.0.trial024.stdout: "same_primary_since": 41, 2026-02-13T05:53:08.960 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:53:08.960 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.960 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:53:08.960 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.960 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.960 INFO:tasks.workunit.client.0.trial024.stdout: "prior_readable_until_ub": 0 2026-02-13T05:53:08.960 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.960 INFO:tasks.workunit.client.0.trial024.stdout: "stats": { 2026-02-13T05:53:08.960 INFO:tasks.workunit.client.0.trial024.stdout: "version": "47'301", 2026-02-13T05:53:08.961 INFO:tasks.workunit.client.0.trial024.stdout: "reported_seq": 331, 2026-02-13T05:53:08.961 INFO:tasks.workunit.client.0.trial024.stdout: "reported_epoch": 47, 2026-02-13T05:53:08.961 INFO:tasks.workunit.client.0.trial024.stdout: "state": "active+undersized+degraded", 2026-02-13T05:53:08.961 INFO:tasks.workunit.client.0.trial024.stdout: "last_fresh": "2026-02-13T05:52:45.415253+0000", 2026-02-13T05:53:08.961 INFO:tasks.workunit.client.0.trial024.stdout: "last_change": "2026-02-13T05:52:39.160593+0000", 2026-02-13T05:53:08.961 INFO:tasks.workunit.client.0.trial024.stdout: "last_active": "2026-02-13T05:52:45.415253+0000", 2026-02-13T05:53:08.961 INFO:tasks.workunit.client.0.trial024.stdout: "last_peered": "2026-02-13T05:52:45.415253+0000", 2026-02-13T05:53:08.961 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean": "2026-02-13T05:52:38.539792+0000", 2026-02-13T05:53:08.961 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_active": "2026-02-13T05:52:39.160593+0000", 2026-02-13T05:53:08.961 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_peered": "2026-02-13T05:52:39.160593+0000", 2026-02-13T05:53:08.961 INFO:tasks.workunit.client.0.trial024.stdout: "last_unstale": "2026-02-13T05:52:45.415253+0000", 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "last_undegraded": "2026-02-13T05:52:39.159290+0000", 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "last_fullsized": "2026-02-13T05:52:39.159192+0000", 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "mapping_epoch": 56, 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "log_start": "47'200", 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_start": "47'200", 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "created": 41, 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 42, 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "parent": "0.0", 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "parent_split_bits": 0, 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:53:08.962 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "objects_scrubbed": 0, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "log_size": 101, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "log_dups_size": 200, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_size": 101, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "stats_invalid": false, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "dirty_stats_invalid": false, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "omap_stats_invalid": false, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_stats_invalid": false, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_bytes_stats_invalid": false, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "pin_stats_invalid": false, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "manifest_stats_invalid": false, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrimq_len": 0, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_duration": 0, 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-14T12:42:43.601462+0000", 2026-02-13T05:53:08.963 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_duration": 0, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "objects_trimmed": 0, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrim_duration": 0, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "stat_sum": { 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes": 1232896, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects": 301, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_clones": 0, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_copies": 1505, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing": 1, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_degraded": 301, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_misplaced": 0, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_unfound": 0, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_dirty": 301, 2026-02-13T05:53:08.964 INFO:tasks.workunit.client.0.trial024.stdout: "num_whiteouts": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_read": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_read_kb": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_write": 301, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_write_kb": 1204, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_scrub_errors": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_deep_scrub_errors": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_recovered": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_recovered": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_keys_recovered": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_omap": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush": 0, 2026-02-13T05:53:08.965 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_kb": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_kb": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_promote": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_high": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_low": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_some": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_full": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_pinned": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_legacy_snapsets": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_large_omap_objects": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_manifest": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_bytes": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_keys": 0, 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_repaired": 0 2026-02-13T05:53:08.966 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: "up": [ 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: 2147483647 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: "acting": [ 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: 2147483647 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: "avail_no_missing": [ 2026-02-13T05:53:08.967 INFO:tasks.workunit.client.0.trial024.stdout: "3(0)", 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: "0(3)", 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: "1(1)", 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: "4(2)" 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: "object_location_counts": [ 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: "objects": 301 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: "blocked_by": [], 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: "up_primary": 3, 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: "acting_primary": 3, 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [] 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: "empty": 0, 2026-02-13T05:53:08.968 INFO:tasks.workunit.client.0.trial024.stdout: "dne": 0, 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "incomplete": 0, 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 57, 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "hit_set_history": { 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "current_last_update": "0'0", 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "history": [] 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "peer": "4(2)", 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "pgid": "2.0s2", 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "shard": "2", 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "last_update": "47'301", 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "last_complete": "47'301", 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "log_tail": "47'200", 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "last_user_version": 301, 2026-02-13T05:53:08.969 INFO:tasks.workunit.client.0.trial024.stdout: "last_backfill": "MAX", 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete": [], 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [], 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "history": { 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_created": 41, 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_pool_created": 41, 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 57, 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_started": 56, 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 42, 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_clean": 41, 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_split": 0, 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_marked_full": 0, 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "same_up_since": 56, 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "same_interval_since": 56, 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "same_primary_since": 41, 2026-02-13T05:53:08.970 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "prior_readable_until_ub": 0 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "stats": { 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "version": "47'301", 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "reported_seq": 331, 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "reported_epoch": 47, 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "state": "active+undersized+degraded", 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "last_fresh": "2026-02-13T05:52:45.415253+0000", 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "last_change": "2026-02-13T05:52:39.160593+0000", 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "last_active": "2026-02-13T05:52:45.415253+0000", 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "last_peered": "2026-02-13T05:52:45.415253+0000", 2026-02-13T05:53:08.971 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean": "2026-02-13T05:52:38.539792+0000", 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_active": "2026-02-13T05:52:39.160593+0000", 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_peered": "2026-02-13T05:52:39.160593+0000", 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "last_unstale": "2026-02-13T05:52:45.415253+0000", 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "last_undegraded": "2026-02-13T05:52:39.159290+0000", 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "last_fullsized": "2026-02-13T05:52:39.159192+0000", 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "mapping_epoch": 56, 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "log_start": "47'200", 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_start": "47'200", 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "created": 41, 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 42, 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "parent": "0.0", 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "parent_split_bits": 0, 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:53:08.972 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:52:33.370705+0000", 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "objects_scrubbed": 0, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "log_size": 101, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "log_dups_size": 200, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_size": 101, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "stats_invalid": false, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "dirty_stats_invalid": false, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "omap_stats_invalid": false, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_stats_invalid": false, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_bytes_stats_invalid": false, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "pin_stats_invalid": false, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "manifest_stats_invalid": false, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrimq_len": 0, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_duration": 0, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-14T12:42:43.601462+0000", 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_duration": 0, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "objects_trimmed": 0, 2026-02-13T05:53:08.973 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrim_duration": 0, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "stat_sum": { 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes": 1232896, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects": 301, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_clones": 0, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_copies": 1505, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing": 0, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_degraded": 301, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_misplaced": 0, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_unfound": 0, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_dirty": 301, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_whiteouts": 0, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_read": 0, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_read_kb": 0, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_write": 301, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_write_kb": 1204, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_scrub_errors": 0, 2026-02-13T05:53:08.974 INFO:tasks.workunit.client.0.trial024.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_deep_scrub_errors": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_recovered": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_recovered": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_keys_recovered": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_omap": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_kb": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_kb": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_promote": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_high": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_low": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_some": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_full": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_pinned": 0, 2026-02-13T05:53:08.975 INFO:tasks.workunit.client.0.trial024.stdout: "num_legacy_snapsets": 0, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: "num_large_omap_objects": 0, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_manifest": 0, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_bytes": 0, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_keys": 0, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_repaired": 0 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: "up": [ 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: 2147483647 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: "acting": [ 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:53:08.976 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: 2147483647 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: "avail_no_missing": [ 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: "3(0)", 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: "0(3)", 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: "1(1)", 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: "4(2)" 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: "object_location_counts": [ 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: "objects": 301 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: "blocked_by": [], 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: "up_primary": 3, 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: "acting_primary": 3, 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [] 2026-02-13T05:53:08.977 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "empty": 0, 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "dne": 0, 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "incomplete": 0, 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 57, 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "hit_set_history": { 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "current_last_update": "0'0", 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "history": [] 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "recovery_state": [ 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "name": "Started/Primary/Active", 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "enter_time": "2026-02-13T05:53:03.627508+0000", 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "might_have_unfound": [ 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "osd": "0(3)", 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "status": "already probed" 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.978 INFO:tasks.workunit.client.0.trial024.stdout: "osd": "1(1)", 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "status": "already probed" 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "osd": "2(4)", 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "status": "osd is down" 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "osd": "4(2)", 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "status": "already probed" 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "recovery_progress": { 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "backfill_targets": [], 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "waiting_on_backfill": [], 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "last_backfill_started": "MIN", 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "backfill_info": { 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "begin": "MIN", 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "end": "MIN", 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "objects": [] 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.979 INFO:tasks.workunit.client.0.trial024.stdout: "peer_backfill_info": [], 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "backfills_in_flight": [], 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "recovering": [], 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "pg_backend": { 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "recovery_ops": [], 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "read_ops": [] 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "name": "Started", 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "enter_time": "2026-02-13T05:53:03.526585+0000" 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "scrubber": { 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "active": false, 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "must_scrub": false, 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "must_deep_scrub": false, 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "must_repair": false, 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_reg_stamp": "2026-02-14T06:16:35.164334+0000", 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: "schedule": "not registered for scrubbing" 2026-02-13T05:53:08.980 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:53:08.981 INFO:tasks.workunit.client.0.trial024.stdout: "agent_state": {} 2026-02-13T05:53:08.981 INFO:tasks.workunit.client.0.trial024.stdout:} 2026-02-13T05:53:08.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:590: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-13T05:53:08.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:590: TEST_ec_backfill_unfound: grep -q obj250 2026-02-13T05:53:09.003 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:592: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-13T05:53:09.003 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:592: TEST_ec_backfill_unfound: jq .available_might_have_unfound 2026-02-13T05:53:09.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:592: TEST_ec_backfill_unfound: check=true 2026-02-13T05:53:09.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: test true == true 2026-02-13T05:53:09.068 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:595: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-13T05:53:09.068 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:595: TEST_ec_backfill_unfound: jq '.might_have_unfound[0].status' 2026-02-13T05:53:09.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:595: TEST_ec_backfill_unfound: eval 'check="osd' is 'down"' 2026-02-13T05:53:09.134 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:595: TEST_ec_backfill_unfound: check='osd is down' 2026-02-13T05:53:09.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:596: TEST_ec_backfill_unfound: test 'osd is down' == 'osd is down' 2026-02-13T05:53:09.134 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-13T05:53:09.134 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: jq '.might_have_unfound[0].osd' 2026-02-13T05:53:09.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: eval 'check="2(4)"' 2026-02-13T05:53:09.205 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: check='2(4)' 2026-02-13T05:53:09.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:599: TEST_ec_backfill_unfound: test '2(4)' == '2(4)' 2026-02-13T05:53:09.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:601: TEST_ec_backfill_unfound: activate_osd td/test-erasure-eio 2 2026-02-13T05:53:09.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:53:09.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:53:09.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T05:53:09.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:53:09.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:53:09.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:53:09.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:53:09.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:53:09.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:53:09.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:53:09.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:53:09.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:53:09.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:53:09.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:53:09.206 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:53:09.206 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:53:09.206 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:53:09.206 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:53:09.206 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:09.206 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:09.207 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:09.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:09.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:53:09.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:53:09.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:53:09.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:53:09.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:53:09.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:53:09.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:53:09.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:53:09.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:53:09.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:53:09.208 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T05:53:09.208 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:53:09.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:53:09.209 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-13T05:53:09.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T05:53:09.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:53:09.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:53:09.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:53:09.221 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:09.219+0000 7fafef364900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:09.222 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:09.221+0000 7fafef364900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:09.223 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:09.222+0000 7fafef364900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:09.358 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:09.356+0000 7fafef364900 -1 Falling back to public interface 2026-02-13T05:53:09.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T05:53:09.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:53:09.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:53:09.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:53:09.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:53:09.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:09.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:53:09.429 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:53:09.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:09.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:53:09.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:53:09.665 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:09.663+0000 7fafef364900 -1 osd.2 55 log_to_monitors true 2026-02-13T05:53:10.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:53:10.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:10.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:53:10.655 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:53:10.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:10.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:53:10.881 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 59 up_thru 19 down_at 56 last_clean_interval [49,55) [v2:127.0.0.1:6818/4248066562,v1:127.0.0.1:6819/4248066562] [v2:127.0.0.1:6820/4248066562,v1:127.0.0.1:6821/4248066562] exists,up 0a89b4df-0567-4e89-9dcf-6514dfbc7a55 2026-02-13T05:53:10.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:53:10.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:53:10.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:53:10.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:604: TEST_ec_backfill_unfound: timeout 5 rados -p pool-jerasure get obj250 td/test-erasure-eio/CHECK 2026-02-13T05:53:15.885 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:605: TEST_ec_backfill_unfound: test 124 = 124 2026-02-13T05:53:15.885 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:607: TEST_ec_backfill_unfound: ceph pg 2.0 mark_unfound_lost delete 2026-02-13T05:53:15.950 INFO:tasks.workunit.client.0.trial024.stderr:pg has no unfound objects 2026-02-13T05:53:15.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:609: TEST_ec_backfill_unfound: wait_for_clean 2026-02-13T05:53:15.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:53:15.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:53:15.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:53:15.957 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:53:15.957 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:53:15.957 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:53:15.957 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:53:15.958 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:53:15.958 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:53:16.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:53:16.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:53:16.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:53:16.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:53:16.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:53:16.040 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:53:16.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:53:16.271 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:53:16.272 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:53:16.272 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:53:16.272 INFO:tasks.workunit.client.0.trial024.stderr:4' 2026-02-13T05:53:16.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:53:16.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:16.272 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:53:16.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803791 2026-02-13T05:53:16.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803791 2026-02-13T05:53:16.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791' 2026-02-13T05:53:16.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:16.336 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:53:16.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574863 2026-02-13T05:53:16.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574863 2026-02-13T05:53:16.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-55834574863' 2026-02-13T05:53:16.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:16.402 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:53:16.466 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070468 2026-02-13T05:53:16.466 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070468 2026-02-13T05:53:16.466 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-55834574863 2-253403070468' 2026-02-13T05:53:16.466 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:16.466 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:53:16.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964117006 2026-02-13T05:53:16.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964117006 2026-02-13T05:53:16.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-55834574863 2-253403070468 3-115964117006' 2026-02-13T05:53:16.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:16.529 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:53:16.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822669 2026-02-13T05:53:16.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822669 2026-02-13T05:53:16.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-55834574863 2-253403070468 3-115964117006 4-154618822669' 2026-02-13T05:53:16.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:16.593 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803791 2026-02-13T05:53:16.593 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:16.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:53:16.594 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803791 2026-02-13T05:53:16.594 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:16.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803791 2026-02-13T05:53:16.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803791' 2026-02-13T05:53:16.596 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803791 2026-02-13T05:53:16.596 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:53:16.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803789 -lt 25769803791 2026-02-13T05:53:16.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:53:17.820 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:53:17.821 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:53:18.050 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803791 -lt 25769803791 2026-02-13T05:53:18.050 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:18.051 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574863 2026-02-13T05:53:18.051 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:18.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:53:18.052 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574863 2026-02-13T05:53:18.052 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:18.053 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574863 2026-02-13T05:53:18.053 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574863' 2026-02-13T05:53:18.054 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 55834574863 2026-02-13T05:53:18.054 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:53:18.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574863 -lt 55834574863 2026-02-13T05:53:18.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:18.280 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-253403070468 2026-02-13T05:53:18.281 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:18.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:53:18.282 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-253403070468 2026-02-13T05:53:18.282 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:18.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=253403070468 2026-02-13T05:53:18.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 253403070468' 2026-02-13T05:53:18.283 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 253403070468 2026-02-13T05:53:18.284 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:53:18.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 253403070468 -lt 253403070468 2026-02-13T05:53:18.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:18.507 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964117006 2026-02-13T05:53:18.508 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:18.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:53:18.508 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964117006 2026-02-13T05:53:18.509 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:18.510 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964117006 2026-02-13T05:53:18.510 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964117006' 2026-02-13T05:53:18.510 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 115964117006 2026-02-13T05:53:18.510 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:53:18.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964117006 -lt 115964117006 2026-02-13T05:53:18.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:18.738 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-154618822669 2026-02-13T05:53:18.738 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:18.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:53:18.739 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-154618822669 2026-02-13T05:53:18.739 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:18.740 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822669 2026-02-13T05:53:18.740 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 154618822669' 2026-02-13T05:53:18.741 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 154618822669 2026-02-13T05:53:18.741 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:53:18.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822669 -lt 154618822669 2026-02-13T05:53:18.973 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:53:18.973 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:53:18.973 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:53:19.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:53:19.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:53:19.281 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:53:19.281 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:53:19.281 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:53:19.282 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:53:19.282 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:53:19.282 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:53:19.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:53:19.503 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:53:19.503 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:53:19.503 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:53:19.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:53:19.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:53:19.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:53:19.816 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: seq 1 300 2026-02-13T05:53:19.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:19.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj1 = obj250 ']' 2026-02-13T05:53:19.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj1 td/test-erasure-eio/CHECK 2026-02-13T05:53:19.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:19.837 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:19.837 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj2 = obj250 ']' 2026-02-13T05:53:19.837 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj2 td/test-erasure-eio/CHECK 2026-02-13T05:53:19.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:19.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:19.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj3 = obj250 ']' 2026-02-13T05:53:19.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj3 td/test-erasure-eio/CHECK 2026-02-13T05:53:19.873 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:19.874 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:19.875 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj4 = obj250 ']' 2026-02-13T05:53:19.875 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj4 td/test-erasure-eio/CHECK 2026-02-13T05:53:19.892 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:19.893 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:19.894 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj5 = obj250 ']' 2026-02-13T05:53:19.894 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj5 td/test-erasure-eio/CHECK 2026-02-13T05:53:19.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:19.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:19.912 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj6 = obj250 ']' 2026-02-13T05:53:19.912 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj6 td/test-erasure-eio/CHECK 2026-02-13T05:53:19.928 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:19.930 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:19.930 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj7 = obj250 ']' 2026-02-13T05:53:19.930 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj7 td/test-erasure-eio/CHECK 2026-02-13T05:53:19.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:19.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:19.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj8 = obj250 ']' 2026-02-13T05:53:19.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj8 td/test-erasure-eio/CHECK 2026-02-13T05:53:19.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:19.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:19.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj9 = obj250 ']' 2026-02-13T05:53:19.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj9 td/test-erasure-eio/CHECK 2026-02-13T05:53:19.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:19.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:19.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj10 = obj250 ']' 2026-02-13T05:53:19.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj10 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj11 = obj250 ']' 2026-02-13T05:53:20.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj11 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.020 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.021 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.021 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj12 = obj250 ']' 2026-02-13T05:53:20.021 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj12 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj13 = obj250 ']' 2026-02-13T05:53:20.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj13 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj14 = obj250 ']' 2026-02-13T05:53:20.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj14 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj15 = obj250 ']' 2026-02-13T05:53:20.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj15 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj16 = obj250 ']' 2026-02-13T05:53:20.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj16 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj17 = obj250 ']' 2026-02-13T05:53:20.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj17 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj18 = obj250 ']' 2026-02-13T05:53:20.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj18 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.152 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.152 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj19 = obj250 ']' 2026-02-13T05:53:20.152 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj19 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj20 = obj250 ']' 2026-02-13T05:53:20.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj20 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj21 = obj250 ']' 2026-02-13T05:53:20.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj21 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.208 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj22 = obj250 ']' 2026-02-13T05:53:20.208 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj22 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj23 = obj250 ']' 2026-02-13T05:53:20.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj23 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj24 = obj250 ']' 2026-02-13T05:53:20.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj24 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj25 = obj250 ']' 2026-02-13T05:53:20.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj25 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj26 = obj250 ']' 2026-02-13T05:53:20.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj26 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj27 = obj250 ']' 2026-02-13T05:53:20.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj27 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.317 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj28 = obj250 ']' 2026-02-13T05:53:20.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj28 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj29 = obj250 ']' 2026-02-13T05:53:20.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj29 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.353 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj30 = obj250 ']' 2026-02-13T05:53:20.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj30 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj31 = obj250 ']' 2026-02-13T05:53:20.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj31 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.390 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.391 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj32 = obj250 ']' 2026-02-13T05:53:20.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj32 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj33 = obj250 ']' 2026-02-13T05:53:20.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj33 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj34 = obj250 ']' 2026-02-13T05:53:20.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj34 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj35 = obj250 ']' 2026-02-13T05:53:20.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj35 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj36 = obj250 ']' 2026-02-13T05:53:20.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj36 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj37 = obj250 ']' 2026-02-13T05:53:20.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj37 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj38 = obj250 ']' 2026-02-13T05:53:20.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj38 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj39 = obj250 ']' 2026-02-13T05:53:20.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj39 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.540 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.540 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj40 = obj250 ']' 2026-02-13T05:53:20.540 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj40 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj41 = obj250 ']' 2026-02-13T05:53:20.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj41 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.578 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.578 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj42 = obj250 ']' 2026-02-13T05:53:20.578 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj42 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj43 = obj250 ']' 2026-02-13T05:53:20.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj43 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.616 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj44 = obj250 ']' 2026-02-13T05:53:20.616 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj44 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj45 = obj250 ']' 2026-02-13T05:53:20.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj45 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj46 = obj250 ']' 2026-02-13T05:53:20.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj46 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj47 = obj250 ']' 2026-02-13T05:53:20.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj47 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj48 = obj250 ']' 2026-02-13T05:53:20.692 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj48 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj49 = obj250 ']' 2026-02-13T05:53:20.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj49 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj50 = obj250 ']' 2026-02-13T05:53:20.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj50 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj51 = obj250 ']' 2026-02-13T05:53:20.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj51 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj52 = obj250 ']' 2026-02-13T05:53:20.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj52 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj53 = obj250 ']' 2026-02-13T05:53:20.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj53 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.806 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.806 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj54 = obj250 ']' 2026-02-13T05:53:20.806 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj54 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj55 = obj250 ']' 2026-02-13T05:53:20.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj55 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.843 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj56 = obj250 ']' 2026-02-13T05:53:20.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj56 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.863 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.863 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj57 = obj250 ']' 2026-02-13T05:53:20.863 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj57 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj58 = obj250 ']' 2026-02-13T05:53:20.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj58 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj59 = obj250 ']' 2026-02-13T05:53:20.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj59 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.916 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.917 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.917 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj60 = obj250 ']' 2026-02-13T05:53:20.917 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj60 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj61 = obj250 ']' 2026-02-13T05:53:20.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj61 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj62 = obj250 ']' 2026-02-13T05:53:20.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj62 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj63 = obj250 ']' 2026-02-13T05:53:20.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj63 td/test-erasure-eio/CHECK 2026-02-13T05:53:20.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:20.993 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:20.993 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj64 = obj250 ']' 2026-02-13T05:53:20.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj64 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj65 = obj250 ']' 2026-02-13T05:53:21.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj65 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj66 = obj250 ']' 2026-02-13T05:53:21.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj66 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj67 = obj250 ']' 2026-02-13T05:53:21.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj67 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.070 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj68 = obj250 ']' 2026-02-13T05:53:21.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj68 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj69 = obj250 ']' 2026-02-13T05:53:21.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj69 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj70 = obj250 ']' 2026-02-13T05:53:21.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj70 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.127 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj71 = obj250 ']' 2026-02-13T05:53:21.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj71 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.147 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.148 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.148 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj72 = obj250 ']' 2026-02-13T05:53:21.148 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj72 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj73 = obj250 ']' 2026-02-13T05:53:21.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj73 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj74 = obj250 ']' 2026-02-13T05:53:21.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj74 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj75 = obj250 ']' 2026-02-13T05:53:21.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj75 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj76 = obj250 ']' 2026-02-13T05:53:21.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj76 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj77 = obj250 ']' 2026-02-13T05:53:21.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj77 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.260 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj78 = obj250 ']' 2026-02-13T05:53:21.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj78 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj79 = obj250 ']' 2026-02-13T05:53:21.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj79 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj80 = obj250 ']' 2026-02-13T05:53:21.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj80 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.317 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.317 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj81 = obj250 ']' 2026-02-13T05:53:21.317 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj81 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj82 = obj250 ']' 2026-02-13T05:53:21.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj82 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj83 = obj250 ']' 2026-02-13T05:53:21.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj83 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.372 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj84 = obj250 ']' 2026-02-13T05:53:21.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj84 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.390 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.391 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.391 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj85 = obj250 ']' 2026-02-13T05:53:21.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj85 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj86 = obj250 ']' 2026-02-13T05:53:21.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj86 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj87 = obj250 ']' 2026-02-13T05:53:21.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj87 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj88 = obj250 ']' 2026-02-13T05:53:21.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj88 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj89 = obj250 ']' 2026-02-13T05:53:21.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj89 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj90 = obj250 ']' 2026-02-13T05:53:21.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj90 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj91 = obj250 ']' 2026-02-13T05:53:21.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj91 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj92 = obj250 ']' 2026-02-13T05:53:21.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj92 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.540 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj93 = obj250 ']' 2026-02-13T05:53:21.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj93 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj94 = obj250 ']' 2026-02-13T05:53:21.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj94 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.578 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj95 = obj250 ']' 2026-02-13T05:53:21.578 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj95 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj96 = obj250 ']' 2026-02-13T05:53:21.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj96 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.616 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.617 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.617 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj97 = obj250 ']' 2026-02-13T05:53:21.617 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj97 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.636 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.636 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj98 = obj250 ']' 2026-02-13T05:53:21.636 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj98 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj99 = obj250 ']' 2026-02-13T05:53:21.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj99 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj100 = obj250 ']' 2026-02-13T05:53:21.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj100 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj101 = obj250 ']' 2026-02-13T05:53:21.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj101 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.709 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj102 = obj250 ']' 2026-02-13T05:53:21.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj102 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.728 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj103 = obj250 ']' 2026-02-13T05:53:21.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj103 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj104 = obj250 ']' 2026-02-13T05:53:21.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj104 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj105 = obj250 ']' 2026-02-13T05:53:21.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj105 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj106 = obj250 ']' 2026-02-13T05:53:21.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj106 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj107 = obj250 ']' 2026-02-13T05:53:21.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj107 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj108 = obj250 ']' 2026-02-13T05:53:21.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj108 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.841 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj109 = obj250 ']' 2026-02-13T05:53:21.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj109 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj110 = obj250 ']' 2026-02-13T05:53:21.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj110 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj111 = obj250 ']' 2026-02-13T05:53:21.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj111 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj112 = obj250 ']' 2026-02-13T05:53:21.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj112 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.917 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.918 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.918 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj113 = obj250 ']' 2026-02-13T05:53:21.918 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj113 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj114 = obj250 ']' 2026-02-13T05:53:21.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj114 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.954 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj115 = obj250 ']' 2026-02-13T05:53:21.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj115 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj116 = obj250 ']' 2026-02-13T05:53:21.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj116 td/test-erasure-eio/CHECK 2026-02-13T05:53:21.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:21.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:21.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj117 = obj250 ']' 2026-02-13T05:53:21.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj117 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj118 = obj250 ']' 2026-02-13T05:53:22.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj118 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.030 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.031 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.031 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj119 = obj250 ']' 2026-02-13T05:53:22.031 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj119 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj120 = obj250 ']' 2026-02-13T05:53:22.049 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj120 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.066 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj121 = obj250 ']' 2026-02-13T05:53:22.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj121 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.086 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.086 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj122 = obj250 ']' 2026-02-13T05:53:22.087 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj122 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.105 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.106 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.106 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj123 = obj250 ']' 2026-02-13T05:53:22.106 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj123 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.123 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.124 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.124 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj124 = obj250 ']' 2026-02-13T05:53:22.124 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj124 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.141 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.142 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.143 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj125 = obj250 ']' 2026-02-13T05:53:22.143 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj125 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.161 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj126 = obj250 ']' 2026-02-13T05:53:22.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj126 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj127 = obj250 ']' 2026-02-13T05:53:22.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj127 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.199 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj128 = obj250 ']' 2026-02-13T05:53:22.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj128 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.219 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.219 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj129 = obj250 ']' 2026-02-13T05:53:22.219 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj129 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj130 = obj250 ']' 2026-02-13T05:53:22.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj130 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.256 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.256 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj131 = obj250 ']' 2026-02-13T05:53:22.256 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj131 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj132 = obj250 ']' 2026-02-13T05:53:22.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj132 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj133 = obj250 ']' 2026-02-13T05:53:22.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj133 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj134 = obj250 ']' 2026-02-13T05:53:22.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj134 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.331 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.332 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.332 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj135 = obj250 ']' 2026-02-13T05:53:22.332 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj135 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.349 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.350 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.350 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj136 = obj250 ']' 2026-02-13T05:53:22.350 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj136 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.368 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj137 = obj250 ']' 2026-02-13T05:53:22.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj137 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj138 = obj250 ']' 2026-02-13T05:53:22.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj138 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj139 = obj250 ']' 2026-02-13T05:53:22.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj139 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj140 = obj250 ']' 2026-02-13T05:53:22.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj140 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.441 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj141 = obj250 ']' 2026-02-13T05:53:22.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj141 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.460 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj142 = obj250 ']' 2026-02-13T05:53:22.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj142 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj143 = obj250 ']' 2026-02-13T05:53:22.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj143 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.498 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.499 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj144 = obj250 ']' 2026-02-13T05:53:22.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj144 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj145 = obj250 ']' 2026-02-13T05:53:22.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj145 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj146 = obj250 ']' 2026-02-13T05:53:22.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj146 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj147 = obj250 ']' 2026-02-13T05:53:22.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj147 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj148 = obj250 ']' 2026-02-13T05:53:22.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj148 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj149 = obj250 ']' 2026-02-13T05:53:22.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj149 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.613 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.613 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj150 = obj250 ']' 2026-02-13T05:53:22.613 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj150 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.630 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj151 = obj250 ']' 2026-02-13T05:53:22.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj151 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj152 = obj250 ']' 2026-02-13T05:53:22.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj152 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj153 = obj250 ']' 2026-02-13T05:53:22.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj153 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj154 = obj250 ']' 2026-02-13T05:53:22.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj154 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.705 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj155 = obj250 ']' 2026-02-13T05:53:22.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj155 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.724 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.725 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.725 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj156 = obj250 ']' 2026-02-13T05:53:22.725 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj156 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.743 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj157 = obj250 ']' 2026-02-13T05:53:22.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj157 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj158 = obj250 ']' 2026-02-13T05:53:22.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj158 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj159 = obj250 ']' 2026-02-13T05:53:22.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj159 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.801 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj160 = obj250 ']' 2026-02-13T05:53:22.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj160 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.820 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj161 = obj250 ']' 2026-02-13T05:53:22.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj161 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.838 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.839 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.839 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj162 = obj250 ']' 2026-02-13T05:53:22.839 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj162 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj163 = obj250 ']' 2026-02-13T05:53:22.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj163 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.875 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.876 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj164 = obj250 ']' 2026-02-13T05:53:22.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj164 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.895 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj165 = obj250 ']' 2026-02-13T05:53:22.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj165 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.915 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.915 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj166 = obj250 ']' 2026-02-13T05:53:22.915 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj166 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj167 = obj250 ']' 2026-02-13T05:53:22.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj167 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.951 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj168 = obj250 ']' 2026-02-13T05:53:22.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj168 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.971 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.971 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj169 = obj250 ']' 2026-02-13T05:53:22.971 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj169 td/test-erasure-eio/CHECK 2026-02-13T05:53:22.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:22.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:22.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj170 = obj250 ']' 2026-02-13T05:53:22.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj170 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj171 = obj250 ']' 2026-02-13T05:53:23.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj171 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj172 = obj250 ']' 2026-02-13T05:53:23.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj172 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.045 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj173 = obj250 ']' 2026-02-13T05:53:23.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj173 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.066 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.066 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj174 = obj250 ']' 2026-02-13T05:53:23.066 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj174 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj175 = obj250 ']' 2026-02-13T05:53:23.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj175 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.104 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj176 = obj250 ']' 2026-02-13T05:53:23.104 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj176 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.122 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.122 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.123 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj177 = obj250 ']' 2026-02-13T05:53:23.123 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj177 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.141 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.141 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj178 = obj250 ']' 2026-02-13T05:53:23.141 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj178 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.159 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj179 = obj250 ']' 2026-02-13T05:53:23.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj179 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.178 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj180 = obj250 ']' 2026-02-13T05:53:23.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj180 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj181 = obj250 ']' 2026-02-13T05:53:23.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj181 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.216 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.217 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj182 = obj250 ']' 2026-02-13T05:53:23.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj182 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj183 = obj250 ']' 2026-02-13T05:53:23.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj183 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.254 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj184 = obj250 ']' 2026-02-13T05:53:23.256 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj184 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj185 = obj250 ']' 2026-02-13T05:53:23.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj185 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj186 = obj250 ']' 2026-02-13T05:53:23.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj186 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj187 = obj250 ']' 2026-02-13T05:53:23.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj187 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj188 = obj250 ']' 2026-02-13T05:53:23.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj188 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.349 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.349 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.350 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj189 = obj250 ']' 2026-02-13T05:53:23.350 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj189 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.368 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj190 = obj250 ']' 2026-02-13T05:53:23.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj190 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj191 = obj250 ']' 2026-02-13T05:53:23.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj191 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj192 = obj250 ']' 2026-02-13T05:53:23.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj192 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj193 = obj250 ']' 2026-02-13T05:53:23.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj193 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.443 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.443 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj194 = obj250 ']' 2026-02-13T05:53:23.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj194 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.460 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj195 = obj250 ']' 2026-02-13T05:53:23.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj195 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj196 = obj250 ']' 2026-02-13T05:53:23.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj196 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.497 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.498 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.498 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj197 = obj250 ']' 2026-02-13T05:53:23.498 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj197 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj198 = obj250 ']' 2026-02-13T05:53:23.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj198 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj199 = obj250 ']' 2026-02-13T05:53:23.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj199 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj200 = obj250 ']' 2026-02-13T05:53:23.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj200 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.570 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.570 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.571 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj201 = obj250 ']' 2026-02-13T05:53:23.571 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj201 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj202 = obj250 ']' 2026-02-13T05:53:23.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj202 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj203 = obj250 ']' 2026-02-13T05:53:23.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj203 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj204 = obj250 ']' 2026-02-13T05:53:23.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj204 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj205 = obj250 ']' 2026-02-13T05:53:23.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj205 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj206 = obj250 ']' 2026-02-13T05:53:23.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj206 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj207 = obj250 ']' 2026-02-13T05:53:23.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj207 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.701 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.701 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj208 = obj250 ']' 2026-02-13T05:53:23.701 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj208 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj209 = obj250 ']' 2026-02-13T05:53:23.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj209 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj210 = obj250 ']' 2026-02-13T05:53:23.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj210 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj211 = obj250 ']' 2026-02-13T05:53:23.756 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj211 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj212 = obj250 ']' 2026-02-13T05:53:23.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj212 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj213 = obj250 ']' 2026-02-13T05:53:23.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj213 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.809 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj214 = obj250 ']' 2026-02-13T05:53:23.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj214 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj215 = obj250 ']' 2026-02-13T05:53:23.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj215 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj216 = obj250 ']' 2026-02-13T05:53:23.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj216 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj217 = obj250 ']' 2026-02-13T05:53:23.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj217 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.886 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj218 = obj250 ']' 2026-02-13T05:53:23.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj218 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.905 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.906 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.907 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj219 = obj250 ']' 2026-02-13T05:53:23.907 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj219 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj220 = obj250 ']' 2026-02-13T05:53:23.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj220 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj221 = obj250 ']' 2026-02-13T05:53:23.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj221 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.961 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.961 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj222 = obj250 ']' 2026-02-13T05:53:23.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj222 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj223 = obj250 ']' 2026-02-13T05:53:23.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj223 td/test-erasure-eio/CHECK 2026-02-13T05:53:23.998 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:23.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:23.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj224 = obj250 ']' 2026-02-13T05:53:23.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj224 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.017 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.017 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj225 = obj250 ']' 2026-02-13T05:53:24.017 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj225 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj226 = obj250 ']' 2026-02-13T05:53:24.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj226 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.053 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj227 = obj250 ']' 2026-02-13T05:53:24.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj227 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj228 = obj250 ']' 2026-02-13T05:53:24.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj228 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj229 = obj250 ']' 2026-02-13T05:53:24.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj229 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj230 = obj250 ']' 2026-02-13T05:53:24.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj230 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.127 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj231 = obj250 ']' 2026-02-13T05:53:24.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj231 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.146 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.147 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.147 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj232 = obj250 ']' 2026-02-13T05:53:24.147 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj232 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj233 = obj250 ']' 2026-02-13T05:53:24.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj233 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj234 = obj250 ']' 2026-02-13T05:53:24.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj234 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj235 = obj250 ']' 2026-02-13T05:53:24.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj235 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj236 = obj250 ']' 2026-02-13T05:53:24.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj236 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj237 = obj250 ']' 2026-02-13T05:53:24.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj237 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.260 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj238 = obj250 ']' 2026-02-13T05:53:24.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj238 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj239 = obj250 ']' 2026-02-13T05:53:24.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj239 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj240 = obj250 ']' 2026-02-13T05:53:24.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj240 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.315 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj241 = obj250 ']' 2026-02-13T05:53:24.317 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj241 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.334 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj242 = obj250 ']' 2026-02-13T05:53:24.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj242 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj243 = obj250 ']' 2026-02-13T05:53:24.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj243 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj244 = obj250 ']' 2026-02-13T05:53:24.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj244 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj245 = obj250 ']' 2026-02-13T05:53:24.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj245 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj246 = obj250 ']' 2026-02-13T05:53:24.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj246 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.431 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj247 = obj250 ']' 2026-02-13T05:53:24.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj247 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.449 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj248 = obj250 ']' 2026-02-13T05:53:24.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj248 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.468 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.469 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj249 = obj250 ']' 2026-02-13T05:53:24.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj249 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.487 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.487 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj250 = obj250 ']' 2026-02-13T05:53:24.487 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:615: TEST_ec_backfill_unfound: rados -p pool-jerasure get obj250 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.503 INFO:tasks.workunit.client.0.trial024.stderr:error getting pool-jerasure/obj250: (2) No such file or directory 2026-02-13T05:53:24.504 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.504 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj251 = obj250 ']' 2026-02-13T05:53:24.504 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj251 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj252 = obj250 ']' 2026-02-13T05:53:24.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj252 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.540 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj253 = obj250 ']' 2026-02-13T05:53:24.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj253 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj254 = obj250 ']' 2026-02-13T05:53:24.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj254 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.575 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj255 = obj250 ']' 2026-02-13T05:53:24.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj255 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj256 = obj250 ']' 2026-02-13T05:53:24.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj256 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.614 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj257 = obj250 ']' 2026-02-13T05:53:24.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj257 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj258 = obj250 ']' 2026-02-13T05:53:24.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj258 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj259 = obj250 ']' 2026-02-13T05:53:24.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj259 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj260 = obj250 ']' 2026-02-13T05:53:24.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj260 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj261 = obj250 ']' 2026-02-13T05:53:24.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj261 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj262 = obj250 ']' 2026-02-13T05:53:24.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj262 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.724 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.725 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj263 = obj250 ']' 2026-02-13T05:53:24.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj263 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.743 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj264 = obj250 ']' 2026-02-13T05:53:24.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj264 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj265 = obj250 ']' 2026-02-13T05:53:24.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj265 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.782 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.783 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj266 = obj250 ']' 2026-02-13T05:53:24.783 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj266 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.801 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj267 = obj250 ']' 2026-02-13T05:53:24.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj267 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.820 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.820 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj268 = obj250 ']' 2026-02-13T05:53:24.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj268 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.838 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj269 = obj250 ']' 2026-02-13T05:53:24.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj269 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj270 = obj250 ']' 2026-02-13T05:53:24.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj270 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.876 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj271 = obj250 ']' 2026-02-13T05:53:24.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj271 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.895 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj272 = obj250 ']' 2026-02-13T05:53:24.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj272 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj273 = obj250 ']' 2026-02-13T05:53:24.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj273 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj274 = obj250 ']' 2026-02-13T05:53:24.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj274 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.951 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj275 = obj250 ']' 2026-02-13T05:53:24.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj275 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.971 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj276 = obj250 ']' 2026-02-13T05:53:24.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj276 td/test-erasure-eio/CHECK 2026-02-13T05:53:24.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:24.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:24.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj277 = obj250 ']' 2026-02-13T05:53:24.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj277 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj278 = obj250 ']' 2026-02-13T05:53:25.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj278 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj279 = obj250 ']' 2026-02-13T05:53:25.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj279 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj280 = obj250 ']' 2026-02-13T05:53:25.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj280 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj281 = obj250 ']' 2026-02-13T05:53:25.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj281 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj282 = obj250 ']' 2026-02-13T05:53:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj282 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj283 = obj250 ']' 2026-02-13T05:53:25.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj283 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj284 = obj250 ']' 2026-02-13T05:53:25.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj284 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj285 = obj250 ']' 2026-02-13T05:53:25.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj285 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.157 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj286 = obj250 ']' 2026-02-13T05:53:25.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj286 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj287 = obj250 ']' 2026-02-13T05:53:25.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj287 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.194 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj288 = obj250 ']' 2026-02-13T05:53:25.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj288 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj289 = obj250 ']' 2026-02-13T05:53:25.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj289 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj290 = obj250 ']' 2026-02-13T05:53:25.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj290 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj291 = obj250 ']' 2026-02-13T05:53:25.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj291 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj292 = obj250 ']' 2026-02-13T05:53:25.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj292 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj293 = obj250 ']' 2026-02-13T05:53:25.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj293 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj294 = obj250 ']' 2026-02-13T05:53:25.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj294 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.325 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj295 = obj250 ']' 2026-02-13T05:53:25.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj295 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj296 = obj250 ']' 2026-02-13T05:53:25.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj296 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj297 = obj250 ']' 2026-02-13T05:53:25.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj297 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.382 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj298 = obj250 ']' 2026-02-13T05:53:25.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj298 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj299 = obj250 ']' 2026-02-13T05:53:25.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj299 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:53:25.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_backfill_unfound: '[' obj300 = obj250 ']' 2026-02-13T05:53:25.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj300 td/test-erasure-eio/CHECK 2026-02-13T05:53:25.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:622: TEST_ec_backfill_unfound: rm -f td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:53:25.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:624: TEST_ec_backfill_unfound: delete_erasure_coded_pool pool-jerasure 2026-02-13T05:53:25.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:53:25.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T05:53:25.711 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T05:53:25.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T05:53:25.992 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T05:53:26.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T05:53:26.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:53:26.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:53:26.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:53:26.002 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:53:26.002 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:53:26.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:53:26.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:53:26.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:53:26.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:53:26.111 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:53:26.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:53:26.112 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:53:26.113 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:53:26.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:53:26.114 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:53:26.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:53:26.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:53:26.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:53:26.116 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:53:26.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:53:26.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:53:26.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:53:26.155 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:53:26.155 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:26.155 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:26.155 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:53:26.157 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:53:26.157 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:53:26.157 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T05:53:26.157 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T05:53:26.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T05:53:26.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T05:53:26.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:53:26.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:53:26.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:53:26.158 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:53:26.158 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:53:26.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:53:26.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:53:26.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:53:26.159 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:53:26.159 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:53:26.159 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:53:26.160 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:53:26.161 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:53:26.161 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:53:26.161 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:53:26.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:53:26.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:53:26.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:53:26.162 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:53:26.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:53:26.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:53:26.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:53:26.165 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:53:26.165 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:26.165 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:26.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:53:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:53:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:53:26.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T05:53:26.167 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:53:26.167 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:26.167 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:26.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T05:53:26.168 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:53:26.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:53:26.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:53:26.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T05:53:26.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T05:53:26.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T05:53:26.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:53:26.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:53:26.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:53:26.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T05:53:26.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T05:53:26.194 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:53:26.194 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:53:26.194 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:53:26.195 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:53:26.195 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:26.195 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:26.195 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:26.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:53:26.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:53:26.222 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:53:26.222 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:53:26.222 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:53:26.223 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:53:26.224 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:53:26.224 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:53:26.224 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:53:26.224 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:53:26.224 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:53:26.224 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:26.224 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:26.224 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:53:26.225 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:53:26.225 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T05:53:26.270 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:53:26.271 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:53:26.271 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:53:26.271 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:53:26.271 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:53:26.273 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:53:26.273 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:53:26.273 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:53:26.273 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:53:26.273 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:26.273 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:26.273 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:53:26.273 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:53:26.273 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T05:53:26.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T05:53:26.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T05:53:26.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:53:26.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:53:26.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:53:26.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T05:53:26.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:53:26.418 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:53:26.419 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:53:26.419 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:53:26.419 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:53:26.419 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:26.419 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:26.419 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:26.419 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:53:26.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:53:26.437 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T05:53:26.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:53:26.533 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:53:26.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:53:27.540 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T05:53:27.540 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:53:27.540 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:53:27.540 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:53:27.541 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:27.541 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:27.541 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:53:27.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T05:53:27.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T05:53:27.582 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:53:27.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T05:53:27.589 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:53:26.214+0000 7f0d8400cd80 0 load: jerasure load: lrc 2026-02-13T05:53:27.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_object_attr_read_error td/test-erasure-eio 2026-02-13T05:53:27.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:379: TEST_ec_object_attr_read_error: local dir=td/test-erasure-eio 2026-02-13T05:53:27.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:380: TEST_ec_object_attr_read_error: local objname=myobject 2026-02-13T05:53:27.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:382: TEST_ec_object_attr_read_error: setup_osds 7 2026-02-13T05:53:27.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=7 2026-02-13T05:53:27.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T05:53:27.590 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 7 - 1 2026-02-13T05:53:27.590 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 6 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:27.592 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:27.593 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:27.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:27.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:53:27.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:53:27.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:53:27.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:53:27.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:53:27.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:53:27.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:53:27.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:53:27.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:53:27.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:53:27.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:53:27.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T05:53:27.594 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:53:27.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=392b9b03-777d-4c5b-bb3f-60fa411cf050 2026-02-13T05:53:27.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 392b9b03-777d-4c5b-bb3f-60fa411cf050' 2026-02-13T05:53:27.594 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 392b9b03-777d-4c5b-bb3f-60fa411cf050 2026-02-13T05:53:27.594 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:53:27.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBXvI5pezcQJBAAOEiSwLhIIhFQvpMNxF/vjw== 2026-02-13T05:53:27.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBXvI5pezcQJBAAOEiSwLhIIhFQvpMNxF/vjw=="}' 2026-02-13T05:53:27.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 392b9b03-777d-4c5b-bb3f-60fa411cf050 -i td/test-erasure-eio/0/new.json 2026-02-13T05:53:27.708 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:53:27.714 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T05:53:27.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBXvI5pezcQJBAAOEiSwLhIIhFQvpMNxF/vjw== --osd-uuid 392b9b03-777d-4c5b-bb3f-60fa411cf050 2026-02-13T05:53:27.733 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:27.733+0000 7f73b5da4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:27.735 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:27.735+0000 7f73b5da4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:27.736 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:27.736+0000 7f73b5da4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:27.736 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:27.736+0000 7f73b5da4900 -1 bdev(0x556c125eac00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:53:27.737 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:27.736+0000 7f73b5da4900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T05:53:28.152 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T05:53:28.152 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:53:28.153 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:53:28.153 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:53:28.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:53:28.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:53:28.258 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:53:28.259 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:53:28.259 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:53:28.259 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:53:28.259 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:53:28.274 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:28.274+0000 7fc5f7eba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:28.276 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:28.275+0000 7fc5f7eba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:28.277 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:28.276+0000 7fc5f7eba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:28.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:53:28.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:53:28.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:53:28.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:53:28.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:53:28.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:28.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:53:28.357 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:53:28.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:28.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:53:28.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:53:28.488 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:28.487+0000 7fc5f7eba900 -1 Falling back to public interface 2026-02-13T05:53:28.757 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:28.757+0000 7fc5f7eba900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:53:29.456 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:53:29.456 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:29.456 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:53:29.456 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:53:29.457 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:29.457 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:53:29.684 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4159114639,v1:127.0.0.1:6803/4159114639] [v2:127.0.0.1:6804/4159114639,v1:127.0.0.1:6805/4159114639] exists,up 392b9b03-777d-4c5b-bb3f-60fa411cf050 2026-02-13T05:53:29.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:53:29.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:53:29.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:53:29.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:53:29.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T05:53:29.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:53:29.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:53:29.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:53:29.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:53:29.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:53:29.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:53:29.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:29.690 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:29.691 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:29.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:29.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:53:29.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:53:29.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:53:29.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:53:29.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:53:29.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:53:29.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:53:29.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:53:29.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:53:29.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:53:29.692 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:53:29.692 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:53:29.692 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:53:29.692 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=909fbd88-54ca-46d0-87fe-6090d1b74c89 2026-02-13T05:53:29.692 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 909fbd88-54ca-46d0-87fe-6090d1b74c89' 2026-02-13T05:53:29.692 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 909fbd88-54ca-46d0-87fe-6090d1b74c89 2026-02-13T05:53:29.692 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:53:29.701 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBZvI5pVzXCKRAAkFsWXlFqdcxlIGME2NUfXA== 2026-02-13T05:53:29.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBZvI5pVzXCKRAAkFsWXlFqdcxlIGME2NUfXA=="}' 2026-02-13T05:53:29.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 909fbd88-54ca-46d0-87fe-6090d1b74c89 -i td/test-erasure-eio/1/new.json 2026-02-13T05:53:29.925 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:53:29.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T05:53:29.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBZvI5pVzXCKRAAkFsWXlFqdcxlIGME2NUfXA== --osd-uuid 909fbd88-54ca-46d0-87fe-6090d1b74c89 2026-02-13T05:53:29.951 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:29.951+0000 7fbef3222900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:29.952 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:29.952+0000 7fbef3222900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:29.954 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:29.953+0000 7fbef3222900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:29.955 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:29.953+0000 7fbef3222900 -1 bdev(0x561b9b192c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:53:29.955 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:29.953+0000 7fbef3222900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T05:53:30.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T05:53:30.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:53:30.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:53:30.272 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:53:30.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:53:30.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:53:30.587 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:53:30.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:53:30.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:53:30.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:53:30.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:53:30.604 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:30.603+0000 7fb970d81900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:30.605 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:30.605+0000 7fb970d81900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:30.606 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:30.606+0000 7fb970d81900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:30.724 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:30.724+0000 7fb970d81900 -1 Falling back to public interface 2026-02-13T05:53:30.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:53:30.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:53:30.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:53:30.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:53:30.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:53:30.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:30.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:53:30.815 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:53:30.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:30.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:53:31.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:53:31.089 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:31.089+0000 7fb970d81900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:53:32.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:53:32.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:32.040 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:53:32.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:53:32.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:32.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:53:32.273 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/315775045,v1:127.0.0.1:6811/315775045] [v2:127.0.0.1:6812/315775045,v1:127.0.0.1:6813/315775045] exists,up 909fbd88-54ca-46d0-87fe-6090d1b74c89 2026-02-13T05:53:32.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:53:32.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:53:32.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:53:32.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:53:32.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T05:53:32.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:53:32.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:53:32.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:53:32.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:53:32.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:53:32.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:53:32.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:53:32.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:53:32.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:53:32.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:53:32.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:53:32.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:53:32.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:53:32.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:53:32.278 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:53:32.278 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:53:32.278 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:53:32.278 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:53:32.279 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:32.279 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:32.279 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:32.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:32.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:53:32.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:53:32.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:53:32.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:53:32.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:53:32.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:53:32.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:53:32.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:53:32.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:53:32.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:53:32.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:53:32.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:53:32.280 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:53:32.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ebb46a75-6344-4c1a-b5a3-e86435fa64fd 2026-02-13T05:53:32.280 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 ebb46a75-6344-4c1a-b5a3-e86435fa64fd 2026-02-13T05:53:32.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 ebb46a75-6344-4c1a-b5a3-e86435fa64fd' 2026-02-13T05:53:32.281 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:53:32.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBcvI5pp6soERAAGH8YtpzUGNMo3D+UR2EoDA== 2026-02-13T05:53:32.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBcvI5pp6soERAAGH8YtpzUGNMo3D+UR2EoDA=="}' 2026-02-13T05:53:32.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ebb46a75-6344-4c1a-b5a3-e86435fa64fd -i td/test-erasure-eio/2/new.json 2026-02-13T05:53:32.516 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:53:32.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T05:53:32.525 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBcvI5pp6soERAAGH8YtpzUGNMo3D+UR2EoDA== --osd-uuid ebb46a75-6344-4c1a-b5a3-e86435fa64fd 2026-02-13T05:53:32.543 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:32.542+0000 7fe446425900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:32.544 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:32.543+0000 7fe446425900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:32.545 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:32.545+0000 7fe446425900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:32.546 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:32.545+0000 7fe446425900 -1 bdev(0x5644e6702c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:53:32.546 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:32.545+0000 7fe446425900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T05:53:32.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T05:53:32.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:53:32.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:53:32.859 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:53:32.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:53:33.168 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:53:33.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:53:33.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:53:33.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:53:33.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:53:33.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:53:33.185 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:33.185+0000 7fcedcfe0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:33.187 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:33.186+0000 7fcedcfe0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:33.188 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:33.187+0000 7fcedcfe0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:33.302 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:33.302+0000 7fcedcfe0900 -1 Falling back to public interface 2026-02-13T05:53:33.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:53:33.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:53:33.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:53:33.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:53:33.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:53:33.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:33.394 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:53:33.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:53:33.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:33.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:53:33.615 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:33.614+0000 7fcedcfe0900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:53:33.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:53:34.619 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:53:34.619 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:34.620 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:53:34.620 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:53:34.621 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:34.621 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:53:34.843 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 17 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2904107848,v1:127.0.0.1:6819/2904107848] [v2:127.0.0.1:6820/2904107848,v1:127.0.0.1:6821/2904107848] exists,up ebb46a75-6344-4c1a-b5a3-e86435fa64fd 2026-02-13T05:53:34.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:53:34.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:53:34.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:53:34.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:53:34.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T05:53:34.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:53:34.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:53:34.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T05:53:34.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:53:34.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:53:34.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:53:34.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:53:34.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:53:34.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:53:34.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:53:34.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:53:34.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:53:34.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:53:34.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:53:34.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:53:34.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:53:34.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:53:34.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:53:34.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:53:34.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:53:34.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:53:34.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:53:34.850 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:53:34.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9685a750-427e-446f-a7bf-7e70abb9005e 2026-02-13T05:53:34.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 9685a750-427e-446f-a7bf-7e70abb9005e' 2026-02-13T05:53:34.851 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 9685a750-427e-446f-a7bf-7e70abb9005e 2026-02-13T05:53:34.851 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:53:34.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBevI5pFx41MxAAXRfsjXN6MOxPjDF+lwpkUQ== 2026-02-13T05:53:34.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBevI5pFx41MxAAXRfsjXN6MOxPjDF+lwpkUQ=="}' 2026-02-13T05:53:34.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9685a750-427e-446f-a7bf-7e70abb9005e -i td/test-erasure-eio/3/new.json 2026-02-13T05:53:35.094 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T05:53:35.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T05:53:35.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBevI5pFx41MxAAXRfsjXN6MOxPjDF+lwpkUQ== --osd-uuid 9685a750-427e-446f-a7bf-7e70abb9005e 2026-02-13T05:53:35.120 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:35.120+0000 7f3a2aed0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:35.122 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:35.121+0000 7f3a2aed0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:35.123 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:35.122+0000 7f3a2aed0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:35.123 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:35.122+0000 7f3a2aed0900 -1 bdev(0x558c12166c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T05:53:35.123 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:35.123+0000 7f3a2aed0900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T05:53:35.436 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T05:53:35.436 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:53:35.437 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T05:53:35.438 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T05:53:35.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:53:35.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T05:53:35.751 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:53:35.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:53:35.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:53:35.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:53:35.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:53:35.768 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:35.767+0000 7f02fdf90900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:35.769 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:35.768+0000 7f02fdf90900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:35.770 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:35.769+0000 7f02fdf90900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:35.905 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:35.904+0000 7f02fdf90900 -1 Falling back to public interface 2026-02-13T05:53:35.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T05:53:35.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:53:35.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:53:35.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:53:35.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:53:35.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:35.980 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:53:35.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:53:35.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:35.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:53:36.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:53:36.257 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:36.256+0000 7f02fdf90900 -1 osd.3 0 log_to_monitors true 2026-02-13T05:53:37.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:53:37.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:37.205 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:53:37.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:53:37.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:37.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:53:37.433 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 24 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2619645640,v1:127.0.0.1:6827/2619645640] [v2:127.0.0.1:6828/2619645640,v1:127.0.0.1:6829/2619645640] exists,up 9685a750-427e-446f-a7bf-7e70abb9005e 2026-02-13T05:53:37.437 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:53:37.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:53:37.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:53:37.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:53:37.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-13T05:53:37.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:53:37.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:53:37.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-13T05:53:37.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:53:37.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-13T05:53:37.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:53:37.439 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:53:37.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:53:37.441 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:53:37.441 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-13T05:53:37.441 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:53:37.441 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5f75b4d8-98f5-4eb5-a812-5374742495ab 2026-02-13T05:53:37.441 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 5f75b4d8-98f5-4eb5-a812-5374742495ab' 2026-02-13T05:53:37.441 INFO:tasks.workunit.client.0.trial024.stdout:add osd4 5f75b4d8-98f5-4eb5-a812-5374742495ab 2026-02-13T05:53:37.442 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:53:37.449 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBhvI5pmMPBGhAAWXh9tbbuA2GxWZHXTr7JPg== 2026-02-13T05:53:37.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBhvI5pmMPBGhAAWXh9tbbuA2GxWZHXTr7JPg=="}' 2026-02-13T05:53:37.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5f75b4d8-98f5-4eb5-a812-5374742495ab -i td/test-erasure-eio/4/new.json 2026-02-13T05:53:37.674 INFO:tasks.workunit.client.0.trial024.stdout:4 2026-02-13T05:53:37.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-13T05:53:37.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBhvI5pmMPBGhAAWXh9tbbuA2GxWZHXTr7JPg== --osd-uuid 5f75b4d8-98f5-4eb5-a812-5374742495ab 2026-02-13T05:53:37.701 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:37.700+0000 7f06c5897900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:37.703 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:37.701+0000 7f06c5897900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:37.704 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:37.702+0000 7f06c5897900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:37.704 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:37.702+0000 7f06c5897900 -1 bdev(0x5617ff24cc00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-13T05:53:37.704 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:37.702+0000 7f06c5897900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-13T05:53:38.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-13T05:53:38.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:53:38.027 INFO:tasks.workunit.client.0.trial024.stdout:adding osd4 key to auth repository 2026-02-13T05:53:38.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-13T05:53:38.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:53:38.341 INFO:tasks.workunit.client.0.trial024.stdout:start osd.4 2026-02-13T05:53:38.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-13T05:53:38.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:53:38.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:53:38.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:53:38.343 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:53:38.358 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:38.356+0000 7fbda3469900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:38.359 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:38.358+0000 7fbda3469900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:38.360 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:38.358+0000 7fbda3469900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:38.503 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:38.501+0000 7fbda3469900 -1 Falling back to public interface 2026-02-13T05:53:38.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-13T05:53:38.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:53:38.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-13T05:53:38.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:53:38.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:53:38.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:38.568 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:53:38.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:53:38.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:38.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:53:38.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:53:38.805 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:38.804+0000 7fbda3469900 -1 osd.4 0 log_to_monitors true 2026-02-13T05:53:39.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:53:39.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:39.799 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:53:39.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:53:39.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:39.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:53:40.021 INFO:tasks.workunit.client.0.trial024.stdout:osd.4 up in weight 1 up_from 33 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/206828999,v1:127.0.0.1:6835/206828999] [v2:127.0.0.1:6836/206828999,v1:127.0.0.1:6837/206828999] exists,up 5f75b4d8-98f5-4eb5-a812-5374742495ab 2026-02-13T05:53:40.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:53:40.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:53:40.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:53:40.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:53:40.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-13T05:53:40.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:53:40.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:53:40.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-13T05:53:40.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:53:40.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-13T05:53:40.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:53:40.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:53:40.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:53:40.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:53:40.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-13T05:53:40.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-13T05:53:40.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:53:40.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:53:40.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:53:40.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:53:40.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:53:40.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:53:40.026 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:53:40.026 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:40.026 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:40.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:40.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:40.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:53:40.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:53:40.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:53:40.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:53:40.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:53:40.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:53:40.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:53:40.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:53:40.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:53:40.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:53:40.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:53:40.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-13T05:53:40.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:53:40.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=83069b60-ef7b-4325-bc64-608aea5e5c23 2026-02-13T05:53:40.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 83069b60-ef7b-4325-bc64-608aea5e5c23' 2026-02-13T05:53:40.028 INFO:tasks.workunit.client.0.trial024.stdout:add osd5 83069b60-ef7b-4325-bc64-608aea5e5c23 2026-02-13T05:53:40.029 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:53:40.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBkvI5pRbUlAhAA5Iwb4HACfmypQVgJSSr9mg== 2026-02-13T05:53:40.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBkvI5pRbUlAhAA5Iwb4HACfmypQVgJSSr9mg=="}' 2026-02-13T05:53:40.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 83069b60-ef7b-4325-bc64-608aea5e5c23 -i td/test-erasure-eio/5/new.json 2026-02-13T05:53:40.263 INFO:tasks.workunit.client.0.trial024.stdout:5 2026-02-13T05:53:40.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-13T05:53:40.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBkvI5pRbUlAhAA5Iwb4HACfmypQVgJSSr9mg== --osd-uuid 83069b60-ef7b-4325-bc64-608aea5e5c23 2026-02-13T05:53:40.290 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:40.289+0000 7f8e3127f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:40.291 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:40.290+0000 7f8e3127f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:40.292 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:40.291+0000 7f8e3127f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:40.293 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:40.291+0000 7f8e3127f900 -1 bdev(0x564c33bfcc00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-13T05:53:40.293 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:40.291+0000 7f8e3127f900 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-13T05:53:40.619 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-13T05:53:40.620 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:53:40.620 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-13T05:53:40.621 INFO:tasks.workunit.client.0.trial024.stdout:adding osd5 key to auth repository 2026-02-13T05:53:40.621 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:53:40.950 INFO:tasks.workunit.client.0.trial024.stdout:start osd.5 2026-02-13T05:53:40.951 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-13T05:53:40.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:53:40.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:53:40.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:53:40.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:53:40.968 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:40.966+0000 7fa356462900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:40.969 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:40.968+0000 7fa356462900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:40.970 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:40.969+0000 7fa356462900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:41.096 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:41.094+0000 7fa356462900 -1 Falling back to public interface 2026-02-13T05:53:41.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-13T05:53:41.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:53:41.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-13T05:53:41.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:53:41.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:53:41.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:41.176 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:53:41.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:53:41.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:41.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:53:41.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:53:41.426 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:41.424+0000 7fa356462900 -1 osd.5 0 log_to_monitors true 2026-02-13T05:53:42.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:53:42.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:42.404 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:53:42.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:53:42.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:42.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:53:42.628 INFO:tasks.workunit.client.0.trial024.stdout:osd.5 up in weight 1 up_from 42 up_thru 43 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2297319554,v1:127.0.0.1:6843/2297319554] [v2:127.0.0.1:6844/2297319554,v1:127.0.0.1:6845/2297319554] exists,up 83069b60-ef7b-4325-bc64-608aea5e5c23 2026-02-13T05:53:42.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:53:42.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:53:42.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:53:42.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:53:42.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-13T05:53:42.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:53:42.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:53:42.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-13T05:53:42.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:53:42.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-13T05:53:42.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:53:42.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:53:42.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:53:42.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:53:42.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-13T05:53:42.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-13T05:53:42.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:53:42.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:53:42.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:53:42.633 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:53:42.633 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:53:42.633 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:53:42.633 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:53:42.633 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:42.634 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:42.634 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:42.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:42.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:53:42.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:53:42.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:53:42.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:53:42.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:53:42.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:53:42.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:53:42.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:53:42.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:53:42.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:53:42.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:53:42.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-13T05:53:42.635 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:53:42.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5b46f92c-ce91-4447-94bd-ea4ac4e25def 2026-02-13T05:53:42.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 5b46f92c-ce91-4447-94bd-ea4ac4e25def' 2026-02-13T05:53:42.635 INFO:tasks.workunit.client.0.trial024.stdout:add osd6 5b46f92c-ce91-4447-94bd-ea4ac4e25def 2026-02-13T05:53:42.636 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:53:42.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBmvI5pr9JSJhAASrcE0bjQogpaYO6914D1Ow== 2026-02-13T05:53:42.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBmvI5pr9JSJhAASrcE0bjQogpaYO6914D1Ow=="}' 2026-02-13T05:53:42.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5b46f92c-ce91-4447-94bd-ea4ac4e25def -i td/test-erasure-eio/6/new.json 2026-02-13T05:53:42.872 INFO:tasks.workunit.client.0.trial024.stdout:6 2026-02-13T05:53:42.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-13T05:53:42.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBmvI5pr9JSJhAASrcE0bjQogpaYO6914D1Ow== --osd-uuid 5b46f92c-ce91-4447-94bd-ea4ac4e25def 2026-02-13T05:53:42.899 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:42.897+0000 7f8fbb38e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:42.900 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:42.899+0000 7f8fbb38e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:42.901 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:42.900+0000 7f8fbb38e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:42.902 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:42.900+0000 7f8fbb38e900 -1 bdev(0x55c5170c8c00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-13T05:53:42.902 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:42.900+0000 7f8fbb38e900 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-13T05:53:43.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-13T05:53:43.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:53:43.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-13T05:53:43.228 INFO:tasks.workunit.client.0.trial024.stdout:adding osd6 key to auth repository 2026-02-13T05:53:43.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:53:43.547 INFO:tasks.workunit.client.0.trial024.stdout:start osd.6 2026-02-13T05:53:43.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-13T05:53:43.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:53:43.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:53:43.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:53:43.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:53:43.564 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:43.563+0000 7fb068662900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:43.566 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:43.564+0000 7fb068662900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:43.567 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:43.565+0000 7fb068662900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:43.729 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:43.728+0000 7fb068662900 -1 Falling back to public interface 2026-02-13T05:53:43.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-13T05:53:43.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:53:43.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-13T05:53:43.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:53:43.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:53:43.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:43.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:53:43.778 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:53:43.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:43.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:53:44.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:53:44.026 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:44.024+0000 7fb068662900 -1 osd.6 0 log_to_monitors true 2026-02-13T05:53:45.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:53:45.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:45.004 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:53:45.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:53:45.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:45.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:53:45.233 INFO:tasks.workunit.client.0.trial024.stdout:osd.6 up in weight 1 up_from 50 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/3346240019,v1:127.0.0.1:6851/3346240019] [v2:127.0.0.1:6852/3346240019,v1:127.0.0.1:6853/3346240019] exists,up 5b46f92c-ce91-4447-94bd-ea4ac4e25def 2026-02-13T05:53:45.234 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:53:45.234 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:53:45.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:53:45.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T05:53:45.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:53:45.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:53:45.235 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:53:45.235 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:45.235 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:45.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:53:45.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T05:53:45.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T05:53:45.279 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:53:45.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T05:53:45.286 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:53:28.490+0000 7fc5f7eba900 0 load: jerasure load: lrc 2026-02-13T05:53:45.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:384: TEST_ec_object_attr_read_error: local poolname=pool-jerasure 2026-02-13T05:53:45.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:385: TEST_ec_object_attr_read_error: create_erasure_coded_pool pool-jerasure 3 2 2026-02-13T05:53:45.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:53:45.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T05:53:45.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-13T05:53:45.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T05:53:45.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-13T05:53:45.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T05:53:45.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-13T05:53:45.575 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T05:53:45.575 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T05:53:45.945 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T05:53:45.953 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:53:46.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T05:53:46.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:53:46.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:53:46.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:53:46.956 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:53:46.956 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:53:46.957 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:53:46.957 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:53:46.957 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:53:46.957 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:53:47.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:53:47.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:53:47.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:53:47.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:53:47.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:53:47.041 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:53:47.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:53:47.263 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:53:47.263 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:53:47.263 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:53:47.264 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:53:47.264 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:53:47.264 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:53:47.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:53:47.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:47.264 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:53:47.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803782 2026-02-13T05:53:47.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803782 2026-02-13T05:53:47.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782' 2026-02-13T05:53:47.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:47.329 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:53:47.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607558 2026-02-13T05:53:47.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607558 2026-02-13T05:53:47.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558' 2026-02-13T05:53:47.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:47.392 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:53:47.456 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444037 2026-02-13T05:53:47.456 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444037 2026-02-13T05:53:47.456 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-73014444037' 2026-02-13T05:53:47.457 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:47.457 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:53:47.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215109 2026-02-13T05:53:47.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215109 2026-02-13T05:53:47.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-73014444037 3-103079215109' 2026-02-13T05:53:47.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:47.521 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:53:47.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920772 2026-02-13T05:53:47.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920772 2026-02-13T05:53:47.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-73014444037 3-103079215109 4-141733920772' 2026-02-13T05:53:47.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:47.585 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:53:47.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626436 2026-02-13T05:53:47.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626436 2026-02-13T05:53:47.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-73014444037 3-103079215109 4-141733920772 5-180388626436' 2026-02-13T05:53:47.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:47.649 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:53:47.714 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364804 2026-02-13T05:53:47.714 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364804 2026-02-13T05:53:47.714 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-73014444037 3-103079215109 4-141733920772 5-180388626436 6-214748364804' 2026-02-13T05:53:47.714 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:47.715 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803782 2026-02-13T05:53:47.715 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:47.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:53:47.716 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803782 2026-02-13T05:53:47.716 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:47.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803782 2026-02-13T05:53:47.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803782' 2026-02-13T05:53:47.717 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803782 2026-02-13T05:53:47.717 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:53:47.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803780 -lt 25769803782 2026-02-13T05:53:47.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:53:48.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:53:48.942 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:53:49.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803782 2026-02-13T05:53:49.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:49.169 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607558 2026-02-13T05:53:49.169 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:49.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:53:49.171 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607558 2026-02-13T05:53:49.171 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:49.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607558 2026-02-13T05:53:49.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607558' 2026-02-13T05:53:49.172 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607558 2026-02-13T05:53:49.173 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:53:49.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607558 -lt 51539607558 2026-02-13T05:53:49.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:49.399 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444037 2026-02-13T05:53:49.399 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:49.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:53:49.401 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444037 2026-02-13T05:53:49.401 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:49.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444037 2026-02-13T05:53:49.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444037' 2026-02-13T05:53:49.403 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 73014444037 2026-02-13T05:53:49.403 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:53:49.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444037 -lt 73014444037 2026-02-13T05:53:49.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:49.625 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-103079215109 2026-02-13T05:53:49.625 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:49.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:53:49.626 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-103079215109 2026-02-13T05:53:49.626 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:49.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=103079215109 2026-02-13T05:53:49.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 103079215109' 2026-02-13T05:53:49.628 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 103079215109 2026-02-13T05:53:49.628 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:53:49.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 103079215109 -lt 103079215109 2026-02-13T05:53:49.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:49.853 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-141733920772 2026-02-13T05:53:49.854 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:49.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:53:49.855 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-141733920772 2026-02-13T05:53:49.855 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:49.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920772 2026-02-13T05:53:49.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 141733920772' 2026-02-13T05:53:49.856 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 141733920772 2026-02-13T05:53:49.857 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:53:50.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920772 -lt 141733920772 2026-02-13T05:53:50.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:50.080 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-180388626436 2026-02-13T05:53:50.080 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:50.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:53:50.082 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-180388626436 2026-02-13T05:53:50.082 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:50.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=180388626436 2026-02-13T05:53:50.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 180388626436' 2026-02-13T05:53:50.083 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 180388626436 2026-02-13T05:53:50.084 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:53:50.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 180388626436 -lt 180388626436 2026-02-13T05:53:50.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:50.308 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-214748364804 2026-02-13T05:53:50.308 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:50.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:53:50.310 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-214748364804 2026-02-13T05:53:50.310 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:50.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=214748364804 2026-02-13T05:53:50.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 214748364804' 2026-02-13T05:53:50.311 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 214748364804 2026-02-13T05:53:50.312 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:53:50.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 214748364805 -lt 214748364804 2026-02-13T05:53:50.534 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:53:50.535 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:53:50.535 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:53:50.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:53:50.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:53:50.847 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:53:50.847 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:53:50.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:53:50.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:53:50.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:53:50.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:53:51.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:53:51.073 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:53:51.073 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:53:51.073 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:53:51.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:53:51.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:53:51.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:53:51.386 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:387: TEST_ec_object_attr_read_error: get_primary pool-jerasure myobject 2026-02-13T05:53:51.386 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=pool-jerasure 2026-02-13T05:53:51.386 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=myobject 2026-02-13T05:53:51.387 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map pool-jerasure myobject 2026-02-13T05:53:51.387 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-13T05:53:51.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:387: TEST_ec_object_attr_read_error: local primary_osd=3 2026-02-13T05:53:51.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:389: TEST_ec_object_attr_read_error: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-13T05:53:51.616 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:53:51.616 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:53:51.616 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:53:51.616 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:53:51.617 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:53:51.722 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:53:51.723 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:392: TEST_ec_object_attr_read_error: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-13T05:53:51.723 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:53:51.723 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:53:51.723 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-13T05:53:51.723 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:53:51.723 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:53:51.723 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:53:51.723 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:53:51.723 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:53:51.723 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:53:51.724 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:53:51.724 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:53:51.724 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-13T05:53:52.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:395: TEST_ec_object_attr_read_error: inject_eio ec mdata pool-jerasure myobject td/test-erasure-eio 1 2026-02-13T05:53:52.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T05:53:52.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T05:53:52.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=mdata 2026-02-13T05:53:52.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T05:53:52.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T05:53:52.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T05:53:52.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=myobject 2026-02-13T05:53:52.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T05:53:52.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T05:53:52.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T05:53:52.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=1 2026-02-13T05:53:52.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T05:53:52.023 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure myobject 2026-02-13T05:53:52.023 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:53:52.023 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-13T05:53:52.023 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-13T05:53:52.023 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:53:52.249 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2147483647 2026-02-13T05:53:52.250 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:53:52.250 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:53:52.250 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:53:52.250 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:53:52.250 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2147483647 5 1 0 6 2026-02-13T05:53:52.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('2147483647' '5' '1' '0' '6') 2026-02-13T05:53:52.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T05:53:52.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=5 2026-02-13T05:53:52.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T05:53:52.251 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/5/type 2026-02-13T05:53:52.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T05:53:52.253 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 5 bluestore_debug_inject_read_err true 2026-02-13T05:53:52.253 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T05:53:52.253 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=5 2026-02-13T05:53:52.253 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T05:53:52.253 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T05:53:52.253 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T05:53:52.253 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.5 2026-02-13T05:53:52.253 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.5 2026-02-13T05:53:52.253 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.5 ']' 2026-02-13T05:53:52.253 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:53:52.253 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:52.253 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:52.254 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.5.asok 2026-02-13T05:53:52.254 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.5.asok config set bluestore_debug_inject_read_err true 2026-02-13T05:53:52.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T05:53:52.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T05:53:52.302 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T05:53:52.303 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.5 2026-02-13T05:53:52.303 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.5 2026-02-13T05:53:52.303 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.5 ']' 2026-02-13T05:53:52.303 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:53:52.303 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:52.303 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:52.304 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.5.asok 2026-02-13T05:53:52.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T05:53:52.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.5.asok injectmdataerr pool-jerasure myobject 1 2026-02-13T05:53:52.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:398: TEST_ec_object_attr_read_error: activate_osd td/test-erasure-eio 3 2026-02-13T05:53:52.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:53:52.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:53:52.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-13T05:53:52.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:53:52.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:53:52.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:53:52.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:53:52.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:53:52.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:53:52.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:53:52.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:53:52.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:53:52.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:53:52.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:53:52.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:53:52.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:53:52.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:53:52.357 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:53:52.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:53:52.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:53:52.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-13T05:53:52.359 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:53:52.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:53:52.360 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-13T05:53:52.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-13T05:53:52.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:53:52.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:53:52.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:53:52.373 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:52.371+0000 7f6847d40900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:52.374 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:52.372+0000 7f6847d40900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:52.375 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:52.373+0000 7f6847d40900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:53:52.513 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:52.511+0000 7f6847d40900 -1 Falling back to public interface 2026-02-13T05:53:52.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-13T05:53:52.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:53:52.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:53:52.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:53:52.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:53:52.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:52.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:53:52.584 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:53:52.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:52.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:53:52.809 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:53:52.829 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:53:52.827+0000 7f6847d40900 -1 osd.3 58 log_to_monitors true 2026-02-13T05:53:53.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:53:53.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:53:53.811 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:53:53.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:53:53.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:53:53.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:53:54.034 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 62 up_thru 62 down_at 59 last_clean_interval [24,58) [v2:127.0.0.1:6826/349481493,v1:127.0.0.1:6827/349481493] [v2:127.0.0.1:6828/349481493,v1:127.0.0.1:6829/349481493] exists,up 9685a750-427e-446f-a7bf-7e70abb9005e 2026-02-13T05:53:54.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:53:54.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:53:54.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:53:54.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:401: TEST_ec_object_attr_read_error: wait_for_clean 2026-02-13T05:53:54.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:53:54.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:53:54.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:53:54.036 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:53:54.036 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:53:54.036 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:53:54.036 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:53:54.036 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:53:54.036 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:53:54.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:53:54.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:53:54.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:53:54.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:53:54.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:53:54.120 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:53:54.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:53:54.342 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:53:54.342 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:53:54.342 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:53:54.342 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:53:54.342 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:53:54.342 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:53:54.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:53:54.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:54.342 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:53:54.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803785 2026-02-13T05:53:54.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803785 2026-02-13T05:53:54.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785' 2026-02-13T05:53:54.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:54.407 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:53:54.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607561 2026-02-13T05:53:54.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607561 2026-02-13T05:53:54.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561' 2026-02-13T05:53:54.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:54.471 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:53:54.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444040 2026-02-13T05:53:54.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444040 2026-02-13T05:53:54.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-73014444040' 2026-02-13T05:53:54.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:54.534 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:53:54.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=266287972355 2026-02-13T05:53:54.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 266287972355 2026-02-13T05:53:54.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-73014444040 3-266287972355' 2026-02-13T05:53:54.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:54.599 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:53:54.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920775 2026-02-13T05:53:54.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920775 2026-02-13T05:53:54.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-73014444040 3-266287972355 4-141733920775' 2026-02-13T05:53:54.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:54.664 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:53:54.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626439 2026-02-13T05:53:54.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626439 2026-02-13T05:53:54.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-73014444040 3-266287972355 4-141733920775 5-180388626439' 2026-02-13T05:53:54.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:53:54.730 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:53:54.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364807 2026-02-13T05:53:54.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364807 2026-02-13T05:53:54.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-73014444040 3-266287972355 4-141733920775 5-180388626439 6-214748364807' 2026-02-13T05:53:54.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:54.797 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803785 2026-02-13T05:53:54.797 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:54.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:53:54.798 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803785 2026-02-13T05:53:54.798 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:54.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803785 2026-02-13T05:53:54.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-13T05:53:54.799 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803785 2026-02-13T05:53:54.800 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:53:55.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803785 -lt 25769803785 2026-02-13T05:53:55.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:55.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607561 2026-02-13T05:53:55.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:55.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:53:55.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607561 2026-02-13T05:53:55.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:55.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607561 2026-02-13T05:53:55.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607561' 2026-02-13T05:53:55.028 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607561 2026-02-13T05:53:55.028 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:53:55.254 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607559 -lt 51539607561 2026-02-13T05:53:55.254 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:53:56.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:53:56.255 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:53:56.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607559 -lt 51539607561 2026-02-13T05:53:56.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:53:57.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T05:53:57.481 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:53:57.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607561 -lt 51539607561 2026-02-13T05:53:57.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:57.712 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444040 2026-02-13T05:53:57.712 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:57.712 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:53:57.713 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444040 2026-02-13T05:53:57.713 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:57.714 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444040 2026-02-13T05:53:57.714 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444040' 2026-02-13T05:53:57.715 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 73014444040 2026-02-13T05:53:57.715 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:53:57.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444041 -lt 73014444040 2026-02-13T05:53:57.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:57.937 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-266287972355 2026-02-13T05:53:57.938 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:57.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:53:57.939 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-266287972355 2026-02-13T05:53:57.939 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:57.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=266287972355 2026-02-13T05:53:57.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 266287972355' 2026-02-13T05:53:57.940 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 266287972355 2026-02-13T05:53:57.941 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:53:58.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 266287972355 -lt 266287972355 2026-02-13T05:53:58.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:58.162 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-141733920775 2026-02-13T05:53:58.163 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:58.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:53:58.164 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-141733920775 2026-02-13T05:53:58.164 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:58.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920775 2026-02-13T05:53:58.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 141733920775' 2026-02-13T05:53:58.166 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 141733920775 2026-02-13T05:53:58.166 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:53:58.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920776 -lt 141733920775 2026-02-13T05:53:58.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:58.400 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-180388626439 2026-02-13T05:53:58.401 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:58.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:53:58.401 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-180388626439 2026-02-13T05:53:58.402 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:58.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=180388626439 2026-02-13T05:53:58.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 180388626439' 2026-02-13T05:53:58.403 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 180388626439 2026-02-13T05:53:58.403 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:53:58.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 180388626440 -lt 180388626439 2026-02-13T05:53:58.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:53:58.628 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-214748364807 2026-02-13T05:53:58.628 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:53:58.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:53:58.629 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-214748364807 2026-02-13T05:53:58.629 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:53:58.630 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=214748364807 2026-02-13T05:53:58.630 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 214748364807' 2026-02-13T05:53:58.631 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 214748364807 2026-02-13T05:53:58.631 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:53:58.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 214748364808 -lt 214748364807 2026-02-13T05:53:58.855 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:53:58.855 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:53:58.855 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:53:59.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:53:59.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:53:59.164 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:53:59.164 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:53:59.164 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:53:59.164 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:53:59.164 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:53:59.164 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:53:59.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:53:59.388 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:53:59.388 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:53:59.388 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:53:59.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:53:59.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:53:59.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:53:59.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:403: TEST_ec_object_attr_read_error: rados_get td/test-erasure-eio pool-jerasure myobject 2026-02-13T05:53:59.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:53:59.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:53:59.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=myobject 2026-02-13T05:53:59.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:53:59.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:53:59.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get myobject td/test-erasure-eio/COPY 2026-02-13T05:53:59.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:53:59.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:53:59.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:405: TEST_ec_object_attr_read_error: delete_erasure_coded_pool pool-jerasure 2026-02-13T05:53:59.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:53:59.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T05:53:59.985 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T05:53:59.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T05:54:00.270 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T05:54:00.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T05:54:00.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:54:00.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:54:00.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:54:00.279 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:54:00.279 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:54:00.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:54:00.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:54:00.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:54:00.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:54:00.389 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:54:00.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:54:00.390 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:54:00.391 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:54:00.391 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:54:00.391 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:54:00.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:54:00.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:54:00.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:54:00.393 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:54:00.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:54:00.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:54:00.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:54:00.409 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:54:00.409 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:00.409 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:00.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:54:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:54:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:54:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T05:54:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T05:54:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T05:54:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T05:54:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:54:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:54:00.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:54:00.412 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:54:00.412 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:54:00.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:54:00.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:54:00.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:54:00.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:54:00.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:54:00.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:54:00.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:54:00.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:54:00.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:54:00.414 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:54:00.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:54:00.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:54:00.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:54:00.416 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:54:00.417 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:54:00.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:54:00.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:54:00.419 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:54:00.419 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:00.419 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:00.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:54:00.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:54:00.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:54:00.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T05:54:00.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:54:00.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:00.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:00.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T05:54:00.422 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:54:00.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:54:00.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:54:00.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T05:54:00.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T05:54:00.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T05:54:00.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:54:00.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:54:00.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:54:00.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T05:54:00.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T05:54:00.444 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:54:00.444 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:00.444 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:00.444 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:00.444 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:00.444 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:00.444 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:00.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:54:00.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:54:00.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:54:00.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:54:00.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:54:00.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:54:00.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:54:00.473 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:54:00.473 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:54:00.473 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:54:00.474 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:00.474 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:00.474 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:00.474 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:54:00.474 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:54:00.474 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T05:54:00.522 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:54:00.522 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:54:00.522 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:54:00.522 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:54:00.522 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:54:00.523 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:54:00.523 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:54:00.523 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:54:00.523 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:00.523 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:00.523 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:00.523 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:54:00.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:54:00.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T05:54:00.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T05:54:00.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T05:54:00.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:54:00.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:54:00.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:54:00.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T05:54:00.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:54:00.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:54:00.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:00.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:00.671 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:00.671 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:00.671 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:00.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:00.672 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:54:00.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:54:00.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T05:54:00.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:54:00.786 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:54:00.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:54:01.795 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T05:54:01.796 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:54:01.796 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:54:01.796 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:01.796 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:01.796 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:01.796 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:54:01.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T05:54:01.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T05:54:01.838 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:54:01.843 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T05:54:01.844 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:54:00.464+0000 7fee66a09d80 0 load: jerasure load: lrc 2026-02-13T05:54:01.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_recovery_multiple_errors td/test-erasure-eio 2026-02-13T05:54:01.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:438: TEST_ec_recovery_multiple_errors: local dir=td/test-erasure-eio 2026-02-13T05:54:01.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:439: TEST_ec_recovery_multiple_errors: local objname=myobject 2026-02-13T05:54:01.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:441: TEST_ec_recovery_multiple_errors: setup_osds 9 2026-02-13T05:54:01.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=9 2026-02-13T05:54:01.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T05:54:01.846 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 9 - 1 2026-02-13T05:54:01.846 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 8 2026-02-13T05:54:01.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:01.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T05:54:01.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:01.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:01.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:54:01.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:01.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T05:54:01.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:54:01.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:01.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:01.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:01.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T05:54:01.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T05:54:01.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:01.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:01.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:01.851 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:01.851 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:01.851 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:01.851 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:01.851 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:01.851 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:01.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:01.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T05:54:01.853 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:01.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=379c24a3-15b8-4f53-ba42-4484c0a15b09 2026-02-13T05:54:01.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 379c24a3-15b8-4f53-ba42-4484c0a15b09' 2026-02-13T05:54:01.853 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 379c24a3-15b8-4f53-ba42-4484c0a15b09 2026-02-13T05:54:01.853 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:01.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB5vI5p1TVNMxAANHeTbhLWzyEnFGeVk5yLKQ== 2026-02-13T05:54:01.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB5vI5p1TVNMxAANHeTbhLWzyEnFGeVk5yLKQ=="}' 2026-02-13T05:54:01.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 379c24a3-15b8-4f53-ba42-4484c0a15b09 -i td/test-erasure-eio/0/new.json 2026-02-13T05:54:01.965 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:01.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T05:54:01.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB5vI5p1TVNMxAANHeTbhLWzyEnFGeVk5yLKQ== --osd-uuid 379c24a3-15b8-4f53-ba42-4484c0a15b09 2026-02-13T05:54:01.991 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:01.990+0000 7f808bb4b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:01.992 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:01.992+0000 7f808bb4b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:01.993 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:01.993+0000 7f808bb4b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:01.994 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:01.993+0000 7f808bb4b900 -1 bdev(0x55a96ec2cc00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:01.994 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:01.993+0000 7f808bb4b900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T05:54:02.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T05:54:02.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:02.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:54:02.402 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:54:02.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:02.506 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:54:02.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:54:02.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:02.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:02.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:02.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:02.524 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:02.524+0000 7f3f9b5b0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:02.526 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:02.525+0000 7f3f9b5b0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:02.527 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:02.526+0000 7f3f9b5b0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:02.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:54:02.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:02.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:54:02.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:02.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:02.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:02.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:02.609 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:02.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:02.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:54:02.705 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:02.720 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:02.719+0000 7f3f9b5b0900 -1 Falling back to public interface 2026-02-13T05:54:03.004 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:03.003+0000 7f3f9b5b0900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:54:03.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:03.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:03.707 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:03.708 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:03.708 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:03.708 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:54:03.930 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1750596704,v1:127.0.0.1:6803/1750596704] [v2:127.0.0.1:6804/1750596704,v1:127.0.0.1:6805/1750596704] exists,up 379c24a3-15b8-4f53-ba42-4484c0a15b09 2026-02-13T05:54:03.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:03.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:03.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:03.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:03.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T05:54:03.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:03.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:03.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:54:03.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:03.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:54:03.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:54:03.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:03.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:03.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:03.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:54:03.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:54:03.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:03.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:03.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:03.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:03.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:03.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:03.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:03.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:03.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:03.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:03.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:54:03.936 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:03.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bb939a1f-5811-4766-b9c3-bdbd84c7b71b 2026-02-13T05:54:03.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 bb939a1f-5811-4766-b9c3-bdbd84c7b71b' 2026-02-13T05:54:03.937 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 bb939a1f-5811-4766-b9c3-bdbd84c7b71b 2026-02-13T05:54:03.938 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:03.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB7vI5pJE9pOBAALEuISJGrNHzUYS+JrVXJCg== 2026-02-13T05:54:03.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB7vI5pJE9pOBAALEuISJGrNHzUYS+JrVXJCg=="}' 2026-02-13T05:54:03.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bb939a1f-5811-4766-b9c3-bdbd84c7b71b -i td/test-erasure-eio/1/new.json 2026-02-13T05:54:04.174 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:04.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T05:54:04.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB7vI5pJE9pOBAALEuISJGrNHzUYS+JrVXJCg== --osd-uuid bb939a1f-5811-4766-b9c3-bdbd84c7b71b 2026-02-13T05:54:04.201 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:04.200+0000 7fe4963da900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:04.202 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:04.202+0000 7fe4963da900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:04.204 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:04.203+0000 7fe4963da900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:04.204 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:04.203+0000 7fe4963da900 -1 bdev(0x560bc8ca4c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:04.204 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:04.203+0000 7fe4963da900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T05:54:04.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T05:54:04.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:04.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:54:04.542 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:54:04.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:04.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:54:04.858 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:54:04.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:04.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:04.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:04.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:04.875 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:04.874+0000 7fe86480e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:04.876 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:04.875+0000 7fe86480e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:04.877 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:04.876+0000 7fe86480e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:05.029 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:05.029+0000 7fe86480e900 -1 Falling back to public interface 2026-02-13T05:54:05.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:54:05.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:05.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:54:05.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:05.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:05.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:05.084 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:05.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:05.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:05.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:54:05.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:05.333 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:05.332+0000 7fe86480e900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:54:06.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:06.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:06.309 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:06.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:06.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:06.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:54:06.534 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4149055687,v1:127.0.0.1:6811/4149055687] [v2:127.0.0.1:6812/4149055687,v1:127.0.0.1:6813/4149055687] exists,up bb939a1f-5811-4766-b9c3-bdbd84c7b71b 2026-02-13T05:54:06.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:06.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:06.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:06.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:06.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T05:54:06.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:06.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:06.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:54:06.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:06.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:54:06.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:54:06.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:06.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:06.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:06.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:54:06.539 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:54:06.540 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:06.540 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:06.540 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:06.540 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:06.540 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:06.540 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:06.540 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:06.540 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:06.540 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:06.540 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:06.540 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:06.540 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:06.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e15b7311-46e4-4bbe-8531-27cdd18c17a4 2026-02-13T05:54:06.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 e15b7311-46e4-4bbe-8531-27cdd18c17a4' 2026-02-13T05:54:06.542 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 e15b7311-46e4-4bbe-8531-27cdd18c17a4 2026-02-13T05:54:06.542 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:06.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB+vI5pwHXCIBAAPs5OJvssdRTSNACmLzXBsQ== 2026-02-13T05:54:06.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB+vI5pwHXCIBAAPs5OJvssdRTSNACmLzXBsQ=="}' 2026-02-13T05:54:06.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e15b7311-46e4-4bbe-8531-27cdd18c17a4 -i td/test-erasure-eio/2/new.json 2026-02-13T05:54:06.779 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:54:06.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T05:54:06.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB+vI5pwHXCIBAAPs5OJvssdRTSNACmLzXBsQ== --osd-uuid e15b7311-46e4-4bbe-8531-27cdd18c17a4 2026-02-13T05:54:06.805 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:06.805+0000 7fefadcfd900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:06.807 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:06.806+0000 7fefadcfd900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:06.808 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:06.807+0000 7fefadcfd900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:06.808 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:06.807+0000 7fefadcfd900 -1 bdev(0x55d6024fec00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:06.808 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:06.808+0000 7fefadcfd900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T05:54:07.145 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T05:54:07.145 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:07.146 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:54:07.146 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:54:07.146 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:07.457 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:54:07.458 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:54:07.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:07.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:07.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:07.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:07.474 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:07.473+0000 7f6134b5d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:07.475 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:07.475+0000 7f6134b5d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:07.476 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:07.476+0000 7f6134b5d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:07.605 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:07.604+0000 7f6134b5d900 -1 Falling back to public interface 2026-02-13T05:54:07.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:54:07.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:07.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:54:07.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:07.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:07.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:07.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:07.682 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:07.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:07.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:54:07.901 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:07.933 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:07.933+0000 7f6134b5d900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:54:08.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:08.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:08.902 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:08.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:08.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:08.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:54:09.125 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2441606610,v1:127.0.0.1:6819/2441606610] [v2:127.0.0.1:6820/2441606610,v1:127.0.0.1:6821/2441606610] exists,up e15b7311-46e4-4bbe-8531-27cdd18c17a4 2026-02-13T05:54:09.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:09.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:09.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:09.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:09.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T05:54:09.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:09.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:09.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T05:54:09.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:09.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:54:09.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:54:09.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:09.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:09.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:09.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:54:09.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:54:09.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:09.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:09.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:09.131 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:09.131 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:09.131 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:09.131 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:09.131 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:09.131 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:09.131 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:09.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:09.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:09.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:09.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:09.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:09.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:09.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:09.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:09.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:09.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:09.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:09.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:09.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:54:09.132 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:09.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=873fb941-d7c1-46c1-a59a-debb289db70e 2026-02-13T05:54:09.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 873fb941-d7c1-46c1-a59a-debb289db70e' 2026-02-13T05:54:09.133 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 873fb941-d7c1-46c1-a59a-debb289db70e 2026-02-13T05:54:09.133 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:09.141 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCBvI5ppRleCBAA9zZZakhhydRX7O0Pnkr2zQ== 2026-02-13T05:54:09.141 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCBvI5ppRleCBAA9zZZakhhydRX7O0Pnkr2zQ=="}' 2026-02-13T05:54:09.141 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 873fb941-d7c1-46c1-a59a-debb289db70e -i td/test-erasure-eio/3/new.json 2026-02-13T05:54:09.368 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T05:54:09.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T05:54:09.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCBvI5ppRleCBAA9zZZakhhydRX7O0Pnkr2zQ== --osd-uuid 873fb941-d7c1-46c1-a59a-debb289db70e 2026-02-13T05:54:09.395 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:09.394+0000 7fdb88da8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:09.396 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:09.396+0000 7fdb88da8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:09.397 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:09.397+0000 7fdb88da8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:09.398 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:09.397+0000 7fdb88da8900 -1 bdev(0x557f69d28c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:09.398 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:09.397+0000 7fdb88da8900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T05:54:09.724 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T05:54:09.725 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:09.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T05:54:09.726 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T05:54:09.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:10.041 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:54:10.042 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T05:54:10.042 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:10.042 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:10.042 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:10.042 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:10.058 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:10.057+0000 7fce412ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:10.059 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:10.059+0000 7fce412ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:10.060 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:10.060+0000 7fce412ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:10.185 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:10.184+0000 7fce412ba900 -1 Falling back to public interface 2026-02-13T05:54:10.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T05:54:10.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:10.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:54:10.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:10.265 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:10.265 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:10.265 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:10.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:10.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:10.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:54:10.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:10.494 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:10.493+0000 7fce412ba900 -1 osd.3 0 log_to_monitors true 2026-02-13T05:54:11.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:11.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:11.488 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:11.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:11.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:11.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:54:11.713 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 26 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/642785809,v1:127.0.0.1:6827/642785809] [v2:127.0.0.1:6828/642785809,v1:127.0.0.1:6829/642785809] exists,up 873fb941-d7c1-46c1-a59a-debb289db70e 2026-02-13T05:54:11.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:11.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:11.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:11.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:11.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-13T05:54:11.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:11.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:11.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-13T05:54:11.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:11.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-13T05:54:11.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:54:11.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:11.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:11.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:11.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-13T05:54:11.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-13T05:54:11.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:11.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:11.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:11.718 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:11.719 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:11.719 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:11.719 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:11.719 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:11.719 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:11.719 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:11.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:11.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:11.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:11.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:11.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:11.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:11.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:11.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:11.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:11.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:11.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:11.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:11.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-13T05:54:11.720 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:11.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=254ea4f9-cd84-4f52-9a00-2f932c782649 2026-02-13T05:54:11.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 254ea4f9-cd84-4f52-9a00-2f932c782649' 2026-02-13T05:54:11.721 INFO:tasks.workunit.client.0.trial024.stdout:add osd4 254ea4f9-cd84-4f52-9a00-2f932c782649 2026-02-13T05:54:11.721 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:11.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCDvI5poN5wKxAAiDnQ/Vm2boaZ7LLTTqdSSw== 2026-02-13T05:54:11.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCDvI5poN5wKxAAiDnQ/Vm2boaZ7LLTTqdSSw=="}' 2026-02-13T05:54:11.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 254ea4f9-cd84-4f52-9a00-2f932c782649 -i td/test-erasure-eio/4/new.json 2026-02-13T05:54:11.964 INFO:tasks.workunit.client.0.trial024.stdout:4 2026-02-13T05:54:11.971 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-13T05:54:11.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCDvI5poN5wKxAAiDnQ/Vm2boaZ7LLTTqdSSw== --osd-uuid 254ea4f9-cd84-4f52-9a00-2f932c782649 2026-02-13T05:54:11.990 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:11.989+0000 7ff8cbaea900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:11.991 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:11.991+0000 7ff8cbaea900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:11.992 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:11.991+0000 7ff8cbaea900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:11.993 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:11.992+0000 7ff8cbaea900 -1 bdev(0x55879624ec00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:11.993 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:11.992+0000 7ff8cbaea900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-13T05:54:12.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-13T05:54:12.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:12.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-13T05:54:12.312 INFO:tasks.workunit.client.0.trial024.stdout:adding osd4 key to auth repository 2026-02-13T05:54:12.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:12.627 INFO:tasks.workunit.client.0.trial024.stdout:start osd.4 2026-02-13T05:54:12.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-13T05:54:12.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:12.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:12.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:12.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:12.644 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:12.643+0000 7f35f8524900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:12.645 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:12.644+0000 7f35f8524900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:12.646 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:12.645+0000 7f35f8524900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:12.811 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:12.811+0000 7f35f8524900 -1 Falling back to public interface 2026-02-13T05:54:12.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-13T05:54:12.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:12.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-13T05:54:12.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:12.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:12.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:12.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:12.851 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:12.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:12.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:54:13.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:13.161 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:13.160+0000 7f35f8524900 -1 osd.4 0 log_to_monitors true 2026-02-13T05:54:14.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:14.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:14.076 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:14.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:14.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:14.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:54:14.302 INFO:tasks.workunit.client.0.trial024.stdout:osd.4 up in weight 1 up_from 34 up_thru 35 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/505465825,v1:127.0.0.1:6835/505465825] [v2:127.0.0.1:6836/505465825,v1:127.0.0.1:6837/505465825] exists,up 254ea4f9-cd84-4f52-9a00-2f932c782649 2026-02-13T05:54:14.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:14.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:14.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:14.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:14.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-13T05:54:14.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:14.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-13T05:54:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-13T05:54:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:54:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-13T05:54:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-13T05:54:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:14.308 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:14.308 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:14.308 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:14.308 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:14.308 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:14.308 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:14.308 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:14.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:14.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:14.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:14.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:14.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:14.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:14.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:14.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:14.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:14.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:14.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:14.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:14.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-13T05:54:14.309 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:14.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=16e4d5ef-99d8-4754-9788-c9fa9dbe96c1 2026-02-13T05:54:14.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 16e4d5ef-99d8-4754-9788-c9fa9dbe96c1' 2026-02-13T05:54:14.310 INFO:tasks.workunit.client.0.trial024.stdout:add osd5 16e4d5ef-99d8-4754-9788-c9fa9dbe96c1 2026-02-13T05:54:14.310 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:14.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCGvI5po3fqEhAAwKp2SCHQax8tngcgKq6EHA== 2026-02-13T05:54:14.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCGvI5po3fqEhAAwKp2SCHQax8tngcgKq6EHA=="}' 2026-02-13T05:54:14.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 16e4d5ef-99d8-4754-9788-c9fa9dbe96c1 -i td/test-erasure-eio/5/new.json 2026-02-13T05:54:14.542 INFO:tasks.workunit.client.0.trial024.stdout:5 2026-02-13T05:54:14.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-13T05:54:14.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCGvI5po3fqEhAAwKp2SCHQax8tngcgKq6EHA== --osd-uuid 16e4d5ef-99d8-4754-9788-c9fa9dbe96c1 2026-02-13T05:54:14.569 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:14.569+0000 7f0c9e872900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:14.571 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:14.570+0000 7f0c9e872900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:14.572 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:14.571+0000 7f0c9e872900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:14.572 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:14.571+0000 7f0c9e872900 -1 bdev(0x55d5fc0fcc00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:14.572 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:14.572+0000 7f0c9e872900 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-13T05:54:14.892 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-13T05:54:14.893 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:14.894 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-13T05:54:14.894 INFO:tasks.workunit.client.0.trial024.stdout:adding osd5 key to auth repository 2026-02-13T05:54:14.894 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:15.203 INFO:tasks.workunit.client.0.trial024.stdout:start osd.5 2026-02-13T05:54:15.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-13T05:54:15.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:15.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:15.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:15.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:15.221 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:15.221+0000 7fc117925900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:15.222 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:15.222+0000 7fc117925900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:15.223 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:15.223+0000 7fc117925900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:15.408 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:15.407+0000 7fc117925900 -1 Falling back to public interface 2026-02-13T05:54:15.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-13T05:54:15.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:15.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-13T05:54:15.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:15.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:15.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:15.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:15.428 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:15.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:15.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:54:15.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:15.740 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:15.740+0000 7fc117925900 -1 osd.5 0 log_to_monitors true 2026-02-13T05:54:16.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:16.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:16.652 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:16.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:16.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:16.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:54:16.876 INFO:tasks.workunit.client.0.trial024.stdout:osd.5 up in weight 1 up_from 42 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2196616065,v1:127.0.0.1:6843/2196616065] [v2:127.0.0.1:6844/2196616065,v1:127.0.0.1:6845/2196616065] exists,up 16e4d5ef-99d8-4754-9788-c9fa9dbe96c1 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:16.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0f939018-7be3-447b-a1c4-816e72a01da6 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 0f939018-7be3-447b-a1c4-816e72a01da6' 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stdout:add osd6 0f939018-7be3-447b-a1c4-816e72a01da6 2026-02-13T05:54:16.881 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:16.893 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCIvI5peEctNRAAOJOw2AfxHF/hDd4ihJXseg== 2026-02-13T05:54:16.893 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCIvI5peEctNRAAOJOw2AfxHF/hDd4ihJXseg=="}' 2026-02-13T05:54:16.893 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0f939018-7be3-447b-a1c4-816e72a01da6 -i td/test-erasure-eio/6/new.json 2026-02-13T05:54:17.116 INFO:tasks.workunit.client.0.trial024.stdout:6 2026-02-13T05:54:17.124 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-13T05:54:17.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCIvI5peEctNRAAOJOw2AfxHF/hDd4ihJXseg== --osd-uuid 0f939018-7be3-447b-a1c4-816e72a01da6 2026-02-13T05:54:17.142 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:17.141+0000 7fda5d40c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:17.143 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:17.143+0000 7fda5d40c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:17.144 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:17.144+0000 7fda5d40c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:17.145 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:17.144+0000 7fda5d40c900 -1 bdev(0x55d9cb214c00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:17.145 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:17.144+0000 7fda5d40c900 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-13T05:54:17.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-13T05:54:17.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:17.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-13T05:54:17.486 INFO:tasks.workunit.client.0.trial024.stdout:adding osd6 key to auth repository 2026-02-13T05:54:17.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:17.813 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-13T05:54:17.813 INFO:tasks.workunit.client.0.trial024.stdout:start osd.6 2026-02-13T05:54:17.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:17.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:17.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:17.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:17.829 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:17.828+0000 7f302905d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:17.830 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:17.830+0000 7f302905d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:17.831 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:17.831+0000 7f302905d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:18.001 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:18.001+0000 7f302905d900 -1 Falling back to public interface 2026-02-13T05:54:18.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-13T05:54:18.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:18.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-13T05:54:18.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:18.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:18.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:18.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:18.049 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:18.049 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:18.049 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:54:18.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:18.362 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:18.361+0000 7f302905d900 -1 osd.6 0 log_to_monitors true 2026-02-13T05:54:19.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:19.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:19.274 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:19.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:19.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:19.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:54:19.496 INFO:tasks.workunit.client.0.trial024.stdout:osd.6 up in weight 1 up_from 50 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/1950842058,v1:127.0.0.1:6851/1950842058] [v2:127.0.0.1:6852/1950842058,v1:127.0.0.1:6853/1950842058] exists,up 0f939018-7be3-447b-a1c4-816e72a01da6 2026-02-13T05:54:19.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:19.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:19.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:19.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:19.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 7 2026-02-13T05:54:19.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:19.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:19.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=7 2026-02-13T05:54:19.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:19.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/7 2026-02-13T05:54:19.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:54:19.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:19.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:19.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:19.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/7' 2026-02-13T05:54:19.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/7/journal' 2026-02-13T05:54:19.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:19.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:19.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:19.502 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:19.502 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:19.502 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:19.502 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:19.502 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:19.502 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:19.502 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:19.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:19.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:19.502 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:19.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:19.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:19.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:19.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:19.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:19.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:19.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:19.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:19.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:19.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/7 2026-02-13T05:54:19.503 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:19.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5de735df-589d-4c7c-9297-2f57d5afa396 2026-02-13T05:54:19.504 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd7 5de735df-589d-4c7c-9297-2f57d5afa396' 2026-02-13T05:54:19.504 INFO:tasks.workunit.client.0.trial024.stdout:add osd7 5de735df-589d-4c7c-9297-2f57d5afa396 2026-02-13T05:54:19.504 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:19.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCLvI5pJhuCHhAAw/4fZT2gNov9jXx7ilmCGg== 2026-02-13T05:54:19.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCLvI5pJhuCHhAAw/4fZT2gNov9jXx7ilmCGg=="}' 2026-02-13T05:54:19.513 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5de735df-589d-4c7c-9297-2f57d5afa396 -i td/test-erasure-eio/7/new.json 2026-02-13T05:54:19.739 INFO:tasks.workunit.client.0.trial024.stdout:7 2026-02-13T05:54:19.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/7/new.json 2026-02-13T05:54:19.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 7 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/7 --osd-journal=td/test-erasure-eio/7/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCLvI5pJhuCHhAAw/4fZT2gNov9jXx7ilmCGg== --osd-uuid 5de735df-589d-4c7c-9297-2f57d5afa396 2026-02-13T05:54:19.767 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:19.765+0000 7f50db297900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:19.768 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:19.767+0000 7f50db297900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:19.769 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:19.768+0000 7f50db297900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:19.770 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:19.768+0000 7f50db297900 -1 bdev(0x559863cd0c00 td/test-erasure-eio/7/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:19.770 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:19.768+0000 7f50db297900 -1 bluestore(td/test-erasure-eio/7) _read_fsid unparsable uuid 2026-02-13T05:54:20.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/7/keyring 2026-02-13T05:54:20.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:20.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd7 key to auth repository 2026-02-13T05:54:20.084 INFO:tasks.workunit.client.0.trial024.stdout:adding osd7 key to auth repository 2026-02-13T05:54:20.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:20.399 INFO:tasks.workunit.client.0.trial024.stdout:start osd.7 2026-02-13T05:54:20.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.7 2026-02-13T05:54:20.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 7 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/7 --osd-journal=td/test-erasure-eio/7/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:20.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:20.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:20.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:20.417 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:20.415+0000 7fac8d305900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:20.418 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:20.417+0000 7fac8d305900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:20.419 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:20.418+0000 7fac8d305900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:20.550 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:20.549+0000 7fac8d305900 -1 Falling back to public interface 2026-02-13T05:54:20.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 7 2026-02-13T05:54:20.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:20.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=7 2026-02-13T05:54:20.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:20.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:20.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:20.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:20.629 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:20.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:20.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-13T05:54:20.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:20.877 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:20.875+0000 7fac8d305900 -1 osd.7 0 log_to_monitors true 2026-02-13T05:54:21.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:21.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:21.855 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:21.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:21.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:21.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-13T05:54:22.085 INFO:tasks.workunit.client.0.trial024.stdout:osd.7 up in weight 1 up_from 58 up_thru 59 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/2256011082,v1:127.0.0.1:6859/2256011082] [v2:127.0.0.1:6860/2256011082,v1:127.0.0.1:6861/2256011082] exists,up 5de735df-589d-4c7c-9297-2f57d5afa396 2026-02-13T05:54:22.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:22.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:22.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:22.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:22.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 8 2026-02-13T05:54:22.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:22.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:22.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=8 2026-02-13T05:54:22.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:22.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/8 2026-02-13T05:54:22.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:54:22.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:22.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:22.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:22.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/8' 2026-02-13T05:54:22.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/8/journal' 2026-02-13T05:54:22.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:22.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:22.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:22.090 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:22.090 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:22.090 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:22.090 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:22.090 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:22.090 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:22.090 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:22.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:22.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:22.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:22.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:22.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:22.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:22.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:22.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:22.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:22.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:22.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:22.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:22.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/8 2026-02-13T05:54:22.091 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:22.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=964f4758-3530-44b5-a3a1-2105be008d93 2026-02-13T05:54:22.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd8 964f4758-3530-44b5-a3a1-2105be008d93' 2026-02-13T05:54:22.092 INFO:tasks.workunit.client.0.trial024.stdout:add osd8 964f4758-3530-44b5-a3a1-2105be008d93 2026-02-13T05:54:22.092 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:22.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCOvI5prFPyBRAAVFzXUDKjLoWAyj5sf5sFvw== 2026-02-13T05:54:22.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCOvI5prFPyBRAAVFzXUDKjLoWAyj5sf5sFvw=="}' 2026-02-13T05:54:22.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 964f4758-3530-44b5-a3a1-2105be008d93 -i td/test-erasure-eio/8/new.json 2026-02-13T05:54:22.327 INFO:tasks.workunit.client.0.trial024.stdout:8 2026-02-13T05:54:22.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/8/new.json 2026-02-13T05:54:22.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 8 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/8 --osd-journal=td/test-erasure-eio/8/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCOvI5prFPyBRAAVFzXUDKjLoWAyj5sf5sFvw== --osd-uuid 964f4758-3530-44b5-a3a1-2105be008d93 2026-02-13T05:54:22.354 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:22.353+0000 7f5266cce900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:22.356 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:22.354+0000 7f5266cce900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:22.357 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:22.355+0000 7f5266cce900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:22.357 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:22.355+0000 7f5266cce900 -1 bdev(0x5564f9156c00 td/test-erasure-eio/8/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:22.357 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:22.356+0000 7f5266cce900 -1 bluestore(td/test-erasure-eio/8) _read_fsid unparsable uuid 2026-02-13T05:54:22.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/8/keyring 2026-02-13T05:54:22.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:22.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd8 key to auth repository 2026-02-13T05:54:22.712 INFO:tasks.workunit.client.0.trial024.stdout:adding osd8 key to auth repository 2026-02-13T05:54:22.712 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:23.026 INFO:tasks.workunit.client.0.trial024.stdout:start osd.8 2026-02-13T05:54:23.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.8 2026-02-13T05:54:23.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 8 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/8 --osd-journal=td/test-erasure-eio/8/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:23.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:23.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:23.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:23.043 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:23.042+0000 7fa9276b6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:23.044 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:23.043+0000 7fa9276b6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:23.045 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:23.044+0000 7fa9276b6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:23.188 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:23.186+0000 7fa9276b6900 -1 Falling back to public interface 2026-02-13T05:54:23.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 8 2026-02-13T05:54:23.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:23.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=8 2026-02-13T05:54:23.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:23.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:23.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:23.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:23.251 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:23.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:23.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-13T05:54:23.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:23.539 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:23.537+0000 7fa9276b6900 -1 osd.8 0 log_to_monitors true 2026-02-13T05:54:24.478 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:24.478 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:24.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:24.479 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:24.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:24.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-13T05:54:24.704 INFO:tasks.workunit.client.0.trial024.stdout:osd.8 up in weight 1 up_from 66 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/2775582441,v1:127.0.0.1:6867/2775582441] [v2:127.0.0.1:6868/2775582441,v1:127.0.0.1:6869/2775582441] exists,up 964f4758-3530-44b5-a3a1-2105be008d93 2026-02-13T05:54:24.705 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:24.705 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:24.705 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:24.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T05:54:24.706 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:54:24.706 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:54:24.706 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:24.706 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:24.706 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:24.706 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:54:24.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T05:54:24.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T05:54:24.752 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:54:24.756 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T05:54:24.759 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:54:02.722+0000 7f3f9b5b0900 0 load: jerasure load: lrc 2026-02-13T05:54:24.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:443: TEST_ec_recovery_multiple_errors: local poolname=pool-jerasure 2026-02-13T05:54:24.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:444: TEST_ec_recovery_multiple_errors: create_erasure_coded_pool pool-jerasure 4 4 2026-02-13T05:54:24.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:54:24.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T05:54:24.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=4 2026-02-13T05:54:24.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T05:54:24.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=4 2026-02-13T05:54:24.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T05:54:24.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=4 m=4 crush-failure-domain=osd 2026-02-13T05:54:25.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T05:54:25.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T05:54:25.433 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T05:54:25.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:54:26.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T05:54:26.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:54:26.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:54:26.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:54:26.444 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:54:26.444 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:54:26.444 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:54:26.445 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:54:26.445 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:54:26.445 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:54:26.526 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:54:26.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:54:26.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:54:26.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:54:26.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:54:26.527 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:54:26.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:54:26.751 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:54:26.751 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:54:26.751 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:54:26.751 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:54:26.751 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:54:26.752 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:54:26.752 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:54:26.752 INFO:tasks.workunit.client.0.trial024.stderr:8' 2026-02-13T05:54:26.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:54:26.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:26.752 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:54:26.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803783 2026-02-13T05:54:26.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803783 2026-02-13T05:54:26.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783' 2026-02-13T05:54:26.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:26.814 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:54:26.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607560 2026-02-13T05:54:26.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607560 2026-02-13T05:54:26.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607560' 2026-02-13T05:54:26.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:26.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:54:26.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411334 2026-02-13T05:54:26.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411334 2026-02-13T05:54:26.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607560 2-77309411334' 2026-02-13T05:54:26.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:26.944 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:54:27.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149702 2026-02-13T05:54:27.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149702 2026-02-13T05:54:27.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607560 2-77309411334 3-111669149702' 2026-02-13T05:54:27.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:27.011 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:54:27.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888069 2026-02-13T05:54:27.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888069 2026-02-13T05:54:27.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607560 2-77309411334 3-111669149702 4-146028888069' 2026-02-13T05:54:27.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:27.074 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:54:27.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626437 2026-02-13T05:54:27.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626437 2026-02-13T05:54:27.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607560 2-77309411334 3-111669149702 4-146028888069 5-180388626437' 2026-02-13T05:54:27.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:27.139 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:54:27.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364804 2026-02-13T05:54:27.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364804 2026-02-13T05:54:27.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607560 2-77309411334 3-111669149702 4-146028888069 5-180388626437 6-214748364804' 2026-02-13T05:54:27.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:27.204 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-13T05:54:27.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103172 2026-02-13T05:54:27.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103172 2026-02-13T05:54:27.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607560 2-77309411334 3-111669149702 4-146028888069 5-180388626437 6-214748364804 7-249108103172' 2026-02-13T05:54:27.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:27.271 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-13T05:54:27.334 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841539 2026-02-13T05:54:27.334 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841539 2026-02-13T05:54:27.334 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803783 1-51539607560 2-77309411334 3-111669149702 4-146028888069 5-180388626437 6-214748364804 7-249108103172 8-283467841539' 2026-02-13T05:54:27.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:27.335 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803783 2026-02-13T05:54:27.335 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:27.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:54:27.336 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803783 2026-02-13T05:54:27.337 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:27.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803783 2026-02-13T05:54:27.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803783' 2026-02-13T05:54:27.338 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803783 2026-02-13T05:54:27.338 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:54:27.561 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803783 2026-02-13T05:54:27.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:54:28.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:54:28.563 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:54:28.783 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803783 -lt 25769803783 2026-02-13T05:54:28.783 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:28.784 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607560 2026-02-13T05:54:28.784 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:28.785 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:54:28.786 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607560 2026-02-13T05:54:28.786 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:28.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607560 2026-02-13T05:54:28.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607560' 2026-02-13T05:54:28.787 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607560 2026-02-13T05:54:28.787 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:54:29.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607560 -lt 51539607560 2026-02-13T05:54:29.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:29.009 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411334 2026-02-13T05:54:29.009 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:29.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:54:29.010 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411334 2026-02-13T05:54:29.010 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:29.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411334 2026-02-13T05:54:29.012 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 77309411334 2026-02-13T05:54:29.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411334' 2026-02-13T05:54:29.012 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:54:29.234 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411334 -lt 77309411334 2026-02-13T05:54:29.234 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:29.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149702 2026-02-13T05:54:29.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:29.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:54:29.236 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149702 2026-02-13T05:54:29.236 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:29.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149702 2026-02-13T05:54:29.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149702' 2026-02-13T05:54:29.238 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 111669149702 2026-02-13T05:54:29.238 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:54:29.460 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149702 -lt 111669149702 2026-02-13T05:54:29.460 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:29.460 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-146028888069 2026-02-13T05:54:29.461 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:29.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:54:29.462 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-146028888069 2026-02-13T05:54:29.462 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:29.463 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888069 2026-02-13T05:54:29.463 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 146028888069' 2026-02-13T05:54:29.464 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 146028888069 2026-02-13T05:54:29.464 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:54:29.685 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888069 -lt 146028888069 2026-02-13T05:54:29.685 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:29.686 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-180388626437 2026-02-13T05:54:29.686 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:29.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:54:29.687 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-180388626437 2026-02-13T05:54:29.688 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:29.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=180388626437 2026-02-13T05:54:29.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 180388626437' 2026-02-13T05:54:29.689 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 180388626437 2026-02-13T05:54:29.690 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:54:29.916 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 180388626437 -lt 180388626437 2026-02-13T05:54:29.916 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:29.917 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-214748364804 2026-02-13T05:54:29.917 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:29.917 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:54:29.918 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-214748364804 2026-02-13T05:54:29.918 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:29.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=214748364804 2026-02-13T05:54:29.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 214748364804' 2026-02-13T05:54:29.920 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 214748364804 2026-02-13T05:54:29.920 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:54:30.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 214748364804 -lt 214748364804 2026-02-13T05:54:30.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:30.140 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-249108103172 2026-02-13T05:54:30.140 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:30.141 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=7 2026-02-13T05:54:30.141 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 7-249108103172 2026-02-13T05:54:30.141 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:30.143 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=249108103172 2026-02-13T05:54:30.143 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.7 seq 249108103172' 2026-02-13T05:54:30.143 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.7 seq 249108103172 2026-02-13T05:54:30.143 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-13T05:54:30.366 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 249108103172 -lt 249108103172 2026-02-13T05:54:30.366 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:30.367 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-283467841539 2026-02-13T05:54:30.367 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:30.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-13T05:54:30.368 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-283467841539 2026-02-13T05:54:30.368 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:30.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=283467841539 2026-02-13T05:54:30.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 283467841539' 2026-02-13T05:54:30.369 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.8 seq 283467841539 2026-02-13T05:54:30.370 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-13T05:54:30.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 283467841539 -lt 283467841539 2026-02-13T05:54:30.595 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:54:30.595 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:54:30.595 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:54:30.917 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:54:30.917 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:54:30.917 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:54:30.917 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:54:30.917 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:54:30.917 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:54:30.917 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:54:30.918 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:54:31.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:54:31.140 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:54:31.140 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:54:31.140 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:54:31.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:54:31.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:54:31.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:54:31.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:446: TEST_ec_recovery_multiple_errors: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-13T05:54:31.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:54:31.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:54:31.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-13T05:54:31.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:54:31.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:54:31.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:54:31.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:54:31.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:54:31.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:54:31.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:54:31.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:54:31.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-13T05:54:31.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:447: TEST_ec_recovery_multiple_errors: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 0 2026-02-13T05:54:31.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T05:54:31.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T05:54:31.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T05:54:31.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T05:54:31.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T05:54:31.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T05:54:31.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=myobject 2026-02-13T05:54:31.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T05:54:31.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T05:54:31.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T05:54:31.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-13T05:54:31.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T05:54:31.474 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure myobject 2026-02-13T05:54:31.474 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:54:31.474 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-13T05:54:31.474 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-13T05:54:31.474 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:54:31.701 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:54:31.701 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:54:31.701 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:54:31.701 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:54:31.701 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:54:31.701 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:54:31.702 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:54:31.702 INFO:tasks.workunit.client.0.trial024.stderr:7' 2026-02-13T05:54:31.702 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2 4 7 2026-02-13T05:54:31.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '5' '1' '0' '6' '2' '4' '7') 2026-02-13T05:54:31.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T05:54:31.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-13T05:54:31.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T05:54:31.702 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-13T05:54:31.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T05:54:31.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-13T05:54:31.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T05:54:31.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-13T05:54:31.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T05:54:31.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T05:54:31.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T05:54:31.705 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-13T05:54:31.705 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T05:54:31.705 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T05:54:31.705 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:31.705 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:31.705 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:31.705 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T05:54:31.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-13T05:54:31.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T05:54:31.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T05:54:31.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T05:54:31.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-13T05:54:31.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T05:54:31.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T05:54:31.755 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:31.755 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:31.755 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:31.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T05:54:31.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T05:54:31.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.3.asok injectdataerr pool-jerasure myobject 0 2026-02-13T05:54:31.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:450: TEST_ec_recovery_multiple_errors: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 3 2026-02-13T05:54:31.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T05:54:31.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T05:54:31.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T05:54:31.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T05:54:31.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T05:54:31.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T05:54:31.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=myobject 2026-02-13T05:54:31.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T05:54:31.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T05:54:31.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T05:54:31.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=3 2026-02-13T05:54:31.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T05:54:31.805 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure myobject 2026-02-13T05:54:31.805 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:54:31.805 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-13T05:54:31.805 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-13T05:54:31.805 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:54:32.031 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:54:32.032 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:54:32.032 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:54:32.032 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:54:32.032 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:54:32.032 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:54:32.032 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:54:32.032 INFO:tasks.workunit.client.0.trial024.stderr:7' 2026-02-13T05:54:32.032 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2 4 7 2026-02-13T05:54:32.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '5' '1' '0' '6' '2' '4' '7') 2026-02-13T05:54:32.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T05:54:32.033 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=0 2026-02-13T05:54:32.033 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T05:54:32.033 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/0/type 2026-02-13T05:54:32.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T05:54:32.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-13T05:54:32.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T05:54:32.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-13T05:54:32.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T05:54:32.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T05:54:32.035 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T05:54:32.035 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-13T05:54:32.035 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:54:32.035 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:54:32.035 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:32.035 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:32.036 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:32.036 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:54:32.036 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-13T05:54:32.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T05:54:32.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T05:54:32.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T05:54:32.085 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.0 2026-02-13T05:54:32.085 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:54:32.086 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:54:32.086 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:32.086 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:32.086 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:32.086 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:54:32.086 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T05:54:32.087 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok injectdataerr pool-jerasure myobject 3 2026-02-13T05:54:32.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:451: TEST_ec_recovery_multiple_errors: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 4 2026-02-13T05:54:32.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T05:54:32.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T05:54:32.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T05:54:32.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T05:54:32.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T05:54:32.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T05:54:32.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=myobject 2026-02-13T05:54:32.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T05:54:32.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T05:54:32.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T05:54:32.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=4 2026-02-13T05:54:32.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T05:54:32.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure myobject 2026-02-13T05:54:32.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:54:32.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-13T05:54:32.137 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-13T05:54:32.137 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:54:32.366 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:54:32.366 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:54:32.367 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:54:32.367 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:54:32.367 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:54:32.367 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:54:32.367 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:54:32.367 INFO:tasks.workunit.client.0.trial024.stderr:7' 2026-02-13T05:54:32.367 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2 4 7 2026-02-13T05:54:32.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '5' '1' '0' '6' '2' '4' '7') 2026-02-13T05:54:32.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T05:54:32.368 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=6 2026-02-13T05:54:32.368 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T05:54:32.368 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/6/type 2026-02-13T05:54:32.370 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T05:54:32.370 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 6 bluestore_debug_inject_read_err true 2026-02-13T05:54:32.370 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T05:54:32.370 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=6 2026-02-13T05:54:32.370 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T05:54:32.370 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T05:54:32.370 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T05:54:32.370 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.6 2026-02-13T05:54:32.370 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.6 2026-02-13T05:54:32.370 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.6 ']' 2026-02-13T05:54:32.370 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:32.370 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:32.371 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:32.371 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.6.asok 2026-02-13T05:54:32.371 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.6.asok config set bluestore_debug_inject_read_err true 2026-02-13T05:54:32.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T05:54:32.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T05:54:32.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T05:54:32.423 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.6 2026-02-13T05:54:32.423 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.6 2026-02-13T05:54:32.423 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.6 ']' 2026-02-13T05:54:32.423 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:32.423 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:32.423 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:32.423 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.6.asok 2026-02-13T05:54:32.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T05:54:32.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.6.asok injectdataerr pool-jerasure myobject 4 2026-02-13T05:54:32.471 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:453: TEST_ec_recovery_multiple_errors: get_osds pool-jerasure myobject 2026-02-13T05:54:32.472 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:54:32.472 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-13T05:54:32.472 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-13T05:54:32.472 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:54:32.698 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:54:32.698 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:54:32.698 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:54:32.698 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:54:32.698 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:54:32.698 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:54:32.699 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:54:32.699 INFO:tasks.workunit.client.0.trial024.stderr:7' 2026-02-13T05:54:32.699 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2 4 7 2026-02-13T05:54:32.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:453: TEST_ec_recovery_multiple_errors: initial_osds=('3' '5' '1' '0' '6' '2' '4' '7') 2026-02-13T05:54:32.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:453: TEST_ec_recovery_multiple_errors: local -a initial_osds 2026-02-13T05:54:32.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:454: TEST_ec_recovery_multiple_errors: local last_osd=7 2026-02-13T05:54:32.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:456: TEST_ec_recovery_multiple_errors: kill_daemons td/test-erasure-eio TERM osd.7 2026-02-13T05:54:32.700 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:54:32.700 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:54:32.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:54:32.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:54:32.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:54:33.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:54:33.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:457: TEST_ec_recovery_multiple_errors: ceph osd down 7 2026-02-13T05:54:33.230 INFO:tasks.workunit.client.0.trial024.stderr:osd.7 is already down. 2026-02-13T05:54:33.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:458: TEST_ec_recovery_multiple_errors: ceph osd out 7 2026-02-13T05:54:33.484 INFO:tasks.workunit.client.0.trial024.stderr:osd.7 is already out. 2026-02-13T05:54:33.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:461: TEST_ec_recovery_multiple_errors: wait_for_clean 2026-02-13T05:54:33.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:54:33.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:54:33.493 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:54:33.493 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:54:33.493 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:54:33.494 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:54:33.494 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:54:33.494 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:54:33.494 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:54:33.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:54:33.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:54:33.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:54:33.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:54:33.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:54:33.577 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:54:33.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:54:33.804 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:54:33.804 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:54:33.804 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:54:33.804 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:54:33.804 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:54:33.804 INFO:tasks.workunit.client.0.trial024.stderr:6 2026-02-13T05:54:33.805 INFO:tasks.workunit.client.0.trial024.stderr:7 2026-02-13T05:54:33.805 INFO:tasks.workunit.client.0.trial024.stderr:8' 2026-02-13T05:54:33.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:54:33.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:33.805 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:54:33.873 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803786 2026-02-13T05:54:33.873 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803786 2026-02-13T05:54:33.873 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786' 2026-02-13T05:54:33.873 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:33.873 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:54:33.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607563 2026-02-13T05:54:33.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607563 2026-02-13T05:54:33.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607563' 2026-02-13T05:54:33.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:33.937 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:54:34.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411337 2026-02-13T05:54:34.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411337 2026-02-13T05:54:34.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607563 2-77309411337' 2026-02-13T05:54:34.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:34.001 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:54:34.066 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149705 2026-02-13T05:54:34.066 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149705 2026-02-13T05:54:34.066 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607563 2-77309411337 3-111669149705' 2026-02-13T05:54:34.066 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:34.066 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:54:34.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888072 2026-02-13T05:54:34.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888072 2026-02-13T05:54:34.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607563 2-77309411337 3-111669149705 4-146028888072' 2026-02-13T05:54:34.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:34.131 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:54:34.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626440 2026-02-13T05:54:34.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626440 2026-02-13T05:54:34.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607563 2-77309411337 3-111669149705 4-146028888072 5-180388626440' 2026-02-13T05:54:34.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:34.195 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:54:34.259 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364807 2026-02-13T05:54:34.260 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364807 2026-02-13T05:54:34.260 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607563 2-77309411337 3-111669149705 4-146028888072 5-180388626440 6-214748364807' 2026-02-13T05:54:34.260 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:34.260 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-13T05:54:34.306 INFO:tasks.workunit.client.0.trial024.stderr:Error ENXIO: problem getting command descriptions from osd.7 2026-02-13T05:54:34.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T05:54:34.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T05:54:34.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-13T05:54:34.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:54:34.308 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-13T05:54:34.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841542 2026-02-13T05:54:34.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841542 2026-02-13T05:54:34.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803786 1-51539607563 2-77309411337 3-111669149705 4-146028888072 5-180388626440 6-214748364807 8-283467841542' 2026-02-13T05:54:34.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:34.374 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803786 2026-02-13T05:54:34.374 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:34.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:54:34.375 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803786 2026-02-13T05:54:34.375 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:34.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803786 2026-02-13T05:54:34.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803786' 2026-02-13T05:54:34.377 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803786 2026-02-13T05:54:34.377 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:54:34.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803784 -lt 25769803786 2026-02-13T05:54:34.597 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:54:35.598 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:54:35.599 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:54:35.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803787 -lt 25769803786 2026-02-13T05:54:35.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:35.823 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607563 2026-02-13T05:54:35.823 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:35.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:54:35.824 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607563 2026-02-13T05:54:35.825 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:35.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607563 2026-02-13T05:54:35.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607563' 2026-02-13T05:54:35.826 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607563 2026-02-13T05:54:35.826 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:54:36.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607563 -lt 51539607563 2026-02-13T05:54:36.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:36.048 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411337 2026-02-13T05:54:36.048 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:36.049 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:54:36.050 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411337 2026-02-13T05:54:36.050 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:36.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411337 2026-02-13T05:54:36.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411337' 2026-02-13T05:54:36.052 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 77309411337 2026-02-13T05:54:36.052 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:54:36.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411338 -lt 77309411337 2026-02-13T05:54:36.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:36.276 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149705 2026-02-13T05:54:36.276 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:36.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:54:36.278 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149705 2026-02-13T05:54:36.278 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:36.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149705 2026-02-13T05:54:36.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149705' 2026-02-13T05:54:36.280 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 111669149705 2026-02-13T05:54:36.280 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:54:36.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149705 -lt 111669149705 2026-02-13T05:54:36.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:36.507 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-146028888072 2026-02-13T05:54:36.508 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:36.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:54:36.509 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-146028888072 2026-02-13T05:54:36.509 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:36.510 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888072 2026-02-13T05:54:36.510 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 146028888072' 2026-02-13T05:54:36.511 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 146028888072 2026-02-13T05:54:36.511 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:54:36.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888073 -lt 146028888072 2026-02-13T05:54:36.736 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:36.737 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-180388626440 2026-02-13T05:54:36.737 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:36.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:54:36.739 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-180388626440 2026-02-13T05:54:36.739 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:36.740 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=180388626440 2026-02-13T05:54:36.740 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 180388626440' 2026-02-13T05:54:36.740 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 180388626440 2026-02-13T05:54:36.741 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:54:36.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 180388626440 -lt 180388626440 2026-02-13T05:54:36.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:36.963 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-214748364807 2026-02-13T05:54:36.963 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:36.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:54:36.965 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-214748364807 2026-02-13T05:54:36.965 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:36.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=214748364807 2026-02-13T05:54:36.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 214748364807' 2026-02-13T05:54:36.966 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 214748364807 2026-02-13T05:54:36.967 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:54:37.194 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 214748364808 -lt 214748364807 2026-02-13T05:54:37.194 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:54:37.195 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-283467841542 2026-02-13T05:54:37.195 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:54:37.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=8 2026-02-13T05:54:37.196 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 8-283467841542 2026-02-13T05:54:37.196 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:54:37.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=283467841542 2026-02-13T05:54:37.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.8 seq 283467841542' 2026-02-13T05:54:37.198 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.8 seq 283467841542 2026-02-13T05:54:37.198 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-13T05:54:37.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 283467841543 -lt 283467841542 2026-02-13T05:54:37.424 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:54:37.424 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:54:37.424 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:54:37.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:54:37.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:54:37.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:54:37.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:54:37.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:54:37.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:54:37.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:54:37.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:54:37.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:54:37.974 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:54:37.974 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:54:37.974 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:54:38.290 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:54:38.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:54:38.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:54:38.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:463: TEST_ec_recovery_multiple_errors: rados_get td/test-erasure-eio pool-jerasure myobject 2026-02-13T05:54:38.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:54:38.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:54:38.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=myobject 2026-02-13T05:54:38.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:54:38.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:54:38.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get myobject td/test-erasure-eio/COPY 2026-02-13T05:54:38.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:54:38.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:54:38.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:465: TEST_ec_recovery_multiple_errors: delete_erasure_coded_pool pool-jerasure 2026-02-13T05:54:38.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:54:38.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T05:54:38.593 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T05:54:38.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T05:54:38.900 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T05:54:38.908 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T05:54:38.909 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:54:38.909 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:54:38.909 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:54:38.910 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:54:38.910 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:54:38.910 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:54:38.910 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:54:38.910 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:54:39.020 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:54:39.021 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:54:39.021 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:54:39.022 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:54:39.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:54:39.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:54:39.023 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:54:39.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:54:39.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:54:39.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:54:39.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:54:39.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:54:39.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:54:39.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:54:39.044 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:54:39.044 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:39.044 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:39.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:54:39.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:54:39.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:54:39.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T05:54:39.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T05:54:39.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T05:54:39.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T05:54:39.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:54:39.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:54:39.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:54:39.047 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:54:39.047 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:54:39.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:54:39.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:54:39.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:54:39.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:54:39.048 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:54:39.049 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:54:39.049 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:54:39.050 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:54:39.050 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:54:39.050 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:54:39.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:54:39.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:54:39.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:54:39.052 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:54:39.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:54:39.053 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:54:39.053 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:54:39.054 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:54:39.055 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:39.055 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:39.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:54:39.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:54:39.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:54:39.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T05:54:39.057 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:54:39.057 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:39.057 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:39.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T05:54:39.058 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:54:39.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:54:39.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:54:39.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T05:54:39.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T05:54:39.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T05:54:39.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:54:39.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:54:39.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:54:39.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T05:54:39.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T05:54:39.079 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:54:39.079 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:39.080 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:39.080 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:39.080 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:39.080 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:39.080 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:39.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:54:39.107 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:54:39.108 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:54:39.108 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:54:39.108 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:54:39.108 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:54:39.108 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:54:39.109 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:54:39.110 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:54:39.110 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:54:39.110 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:39.110 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:39.110 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:39.110 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:54:39.110 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:54:39.110 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T05:54:39.153 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:54:39.154 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:54:39.154 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:54:39.154 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:54:39.154 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:54:39.155 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:54:39.155 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:54:39.155 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:54:39.155 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:39.155 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:39.156 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:39.156 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:54:39.156 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:54:39.156 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T05:54:39.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T05:54:39.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T05:54:39.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:54:39.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:54:39.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:54:39.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T05:54:39.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:54:39.302 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:54:39.302 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:39.302 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:39.302 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:39.302 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:39.303 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:39.303 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:39.303 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:54:39.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:54:39.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T05:54:39.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:54:39.418 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:54:39.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:54:40.427 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T05:54:40.427 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:54:40.427 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:54:40.427 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:40.427 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:40.428 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:40.428 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:54:40.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T05:54:40.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T05:54:40.469 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:54:40.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T05:54:40.474 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:54:39.099+0000 7fdabe7cdd80 0 load: jerasure load: lrc 2026-02-13T05:54:40.476 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_recovery_multiple_objects td/test-erasure-eio 2026-02-13T05:54:40.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:471: TEST_ec_recovery_multiple_objects: local dir=td/test-erasure-eio 2026-02-13T05:54:40.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:472: TEST_ec_recovery_multiple_objects: local objname=myobject 2026-02-13T05:54:40.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:474: TEST_ec_recovery_multiple_objects: ORIG_ARGS='--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:54:40.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:475: TEST_ec_recovery_multiple_objects: CEPH_ARGS+=' --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:54:40.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:476: TEST_ec_recovery_multiple_objects: setup_osds 7 2026-02-13T05:54:40.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=7 2026-02-13T05:54:40.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T05:54:40.477 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 7 - 1 2026-02-13T05:54:40.477 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 6 2026-02-13T05:54:40.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:40.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T05:54:40.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:40.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:40.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:54:40.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:40.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T05:54:40.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:54:40.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:40.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:40.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:40.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T05:54:40.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T05:54:40.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:40.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:40.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:40.483 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:40.483 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:40.483 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:40.483 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:40.483 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:40.483 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:40.483 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:40.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:40.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:40.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:40.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:40.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:40.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:40.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:40.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:40.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:40.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:40.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:40.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:40.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T05:54:40.484 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:40.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a106c8cd-5666-4b99-94e3-d8d55f4814a5 2026-02-13T05:54:40.485 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 a106c8cd-5666-4b99-94e3-d8d55f4814a5 2026-02-13T05:54:40.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a106c8cd-5666-4b99-94e3-d8d55f4814a5' 2026-02-13T05:54:40.485 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:40.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCgvI5pYJhfHRAAkTxgGud/vv8ZoP4WQrcYmA== 2026-02-13T05:54:40.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCgvI5pYJhfHRAAkTxgGud/vv8ZoP4WQrcYmA=="}' 2026-02-13T05:54:40.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a106c8cd-5666-4b99-94e3-d8d55f4814a5 -i td/test-erasure-eio/0/new.json 2026-02-13T05:54:40.607 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:40.614 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T05:54:40.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCgvI5pYJhfHRAAkTxgGud/vv8ZoP4WQrcYmA== --osd-uuid a106c8cd-5666-4b99-94e3-d8d55f4814a5 2026-02-13T05:54:40.635 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:40.634+0000 7f7b91fed900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:40.636 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:40.636+0000 7f7b91fed900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:40.637 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:40.637+0000 7f7b91fed900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:40.638 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:40.637+0000 7f7b91fed900 -1 bdev(0x55955a520c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:40.638 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:40.637+0000 7f7b91fed900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T05:54:41.070 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T05:54:41.070 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:41.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:54:41.071 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:54:41.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:41.179 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:54:41.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:54:41.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:41.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:41.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:41.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:41.199 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:41.198+0000 7f856a65d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:41.200 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:41.200+0000 7f856a65d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:41.201 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:41.201+0000 7f856a65d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:41.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:54:41.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:41.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:54:41.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:41.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:41.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:41.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:41.282 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:41.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:41.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:54:41.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:41.417 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:41.416+0000 7f856a65d900 -1 Falling back to public interface 2026-02-13T05:54:41.673 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:41.672+0000 7f856a65d900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:54:42.384 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:42.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:42.385 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:42.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:42.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:42.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:54:42.622 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/18243264,v1:127.0.0.1:6803/18243264] [v2:127.0.0.1:6804/18243264,v1:127.0.0.1:6805/18243264] exists,up a106c8cd-5666-4b99-94e3-d8d55f4814a5 2026-02-13T05:54:42.625 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:42.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:42.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:42.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:42.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T05:54:42.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:42.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:42.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:54:42.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:42.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:54:42.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:54:42.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:42.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:42.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:42.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:54:42.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:54:42.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:42.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:42.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:42.627 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:42.627 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:42.627 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:42.628 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:42.628 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:42.628 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:42.628 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:42.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:42.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:42.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:42.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:42.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:42.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:42.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:42.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:42.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:42.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:42.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:42.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:42.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:54:42.629 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:42.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=acb7715f-544d-41c4-ba42-160ecb341822 2026-02-13T05:54:42.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 acb7715f-544d-41c4-ba42-160ecb341822' 2026-02-13T05:54:42.629 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 acb7715f-544d-41c4-ba42-160ecb341822 2026-02-13T05:54:42.630 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:42.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCivI5pdh4KJhAApCIzgpLsbYS0dke+TYBEaw== 2026-02-13T05:54:42.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCivI5pdh4KJhAApCIzgpLsbYS0dke+TYBEaw=="}' 2026-02-13T05:54:42.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new acb7715f-544d-41c4-ba42-160ecb341822 -i td/test-erasure-eio/1/new.json 2026-02-13T05:54:42.869 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:42.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T05:54:42.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCivI5pdh4KJhAApCIzgpLsbYS0dke+TYBEaw== --osd-uuid acb7715f-544d-41c4-ba42-160ecb341822 2026-02-13T05:54:42.899 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:42.898+0000 7eff95f4b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:42.900 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:42.899+0000 7eff95f4b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:42.901 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:42.900+0000 7eff95f4b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:42.901 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:42.901+0000 7eff95f4b900 -1 bdev(0x55742b52ac00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:42.902 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:42.901+0000 7eff95f4b900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T05:54:43.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T05:54:43.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:43.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:54:43.232 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:54:43.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:43.562 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:54:43.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:54:43.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:43.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:43.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:43.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:43.581 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:43.581+0000 7f7a1ac97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:43.583 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:43.582+0000 7f7a1ac97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:43.583 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:43.583+0000 7f7a1ac97900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:43.718 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:43.717+0000 7f7a1ac97900 -1 Falling back to public interface 2026-02-13T05:54:43.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:54:43.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:43.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:54:43.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:43.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:43.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:43.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:43.789 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:43.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:43.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:54:43.989 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:43.988+0000 7f7a1ac97900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:54:44.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:45.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:45.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:45.014 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:45.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:45.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:45.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:54:45.239 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3846677580,v1:127.0.0.1:6811/3846677580] [v2:127.0.0.1:6812/3846677580,v1:127.0.0.1:6813/3846677580] exists,up acb7715f-544d-41c4-ba42-160ecb341822 2026-02-13T05:54:45.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:45.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:45.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:45.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:45.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T05:54:45.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:45.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:45.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:54:45.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:45.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:54:45.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:45.244 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:45.245 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:45.245 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:45.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:45.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:45.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:45.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:45.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:45.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:45.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:45.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:45.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:45.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:45.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:45.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:45.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:54:45.246 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:45.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2cbe6f02-e04a-434c-8f30-176d172cae55 2026-02-13T05:54:45.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 2cbe6f02-e04a-434c-8f30-176d172cae55' 2026-02-13T05:54:45.247 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 2cbe6f02-e04a-434c-8f30-176d172cae55 2026-02-13T05:54:45.247 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:45.256 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQClvI5p4R8+DxAAxUZd9eG/X1wXAoScjVVEhw== 2026-02-13T05:54:45.256 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQClvI5p4R8+DxAAxUZd9eG/X1wXAoScjVVEhw=="}' 2026-02-13T05:54:45.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2cbe6f02-e04a-434c-8f30-176d172cae55 -i td/test-erasure-eio/2/new.json 2026-02-13T05:54:45.483 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:54:45.491 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T05:54:45.493 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQClvI5p4R8+DxAAxUZd9eG/X1wXAoScjVVEhw== --osd-uuid 2cbe6f02-e04a-434c-8f30-176d172cae55 2026-02-13T05:54:45.513 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:45.512+0000 7ff7b9c05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:45.514 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:45.513+0000 7ff7b9c05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:45.515 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:45.514+0000 7ff7b9c05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:45.515 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:45.515+0000 7ff7b9c05900 -1 bdev(0x56197d918c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:45.516 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:45.515+0000 7ff7b9c05900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T05:54:45.834 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T05:54:45.834 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:45.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:54:45.835 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:54:45.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:46.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:54:46.150 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:54:46.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:46.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:46.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:46.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:46.169 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:46.169+0000 7fc2ae0f3900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:46.171 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:46.170+0000 7fc2ae0f3900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:46.172 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:46.171+0000 7fc2ae0f3900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:46.308 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:46.307+0000 7fc2ae0f3900 -1 Falling back to public interface 2026-02-13T05:54:46.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:54:46.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:46.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:54:46.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:46.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:46.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:46.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:46.374 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:46.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:46.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:54:46.598 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:46.597+0000 7fc2ae0f3900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:54:46.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:47.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:47.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:47.601 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:47.601 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:47.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:47.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:54:47.825 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 19 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1442061643,v1:127.0.0.1:6819/1442061643] [v2:127.0.0.1:6820/1442061643,v1:127.0.0.1:6821/1442061643] exists,up 2cbe6f02-e04a-434c-8f30-176d172cae55 2026-02-13T05:54:47.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:47.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:47.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:47.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:47.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T05:54:47.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:47.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:47.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T05:54:47.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:47.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:47.830 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:47.831 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:47.831 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:47.831 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:47.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:47.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:47.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:47.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:47.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:47.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:47.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:47.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:47.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:47.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:47.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:47.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:47.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:54:47.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:47.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d1d22331-d648-4df3-9d4e-ed29043c15b1 2026-02-13T05:54:47.833 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 d1d22331-d648-4df3-9d4e-ed29043c15b1' 2026-02-13T05:54:47.833 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 d1d22331-d648-4df3-9d4e-ed29043c15b1 2026-02-13T05:54:47.833 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:47.843 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCnvI5pL3ItMhAAZFFP58QgMXOTE1Fzh7MsPA== 2026-02-13T05:54:47.843 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCnvI5pL3ItMhAAZFFP58QgMXOTE1Fzh7MsPA=="}' 2026-02-13T05:54:47.843 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d1d22331-d648-4df3-9d4e-ed29043c15b1 -i td/test-erasure-eio/3/new.json 2026-02-13T05:54:48.073 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T05:54:48.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T05:54:48.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCnvI5pL3ItMhAAZFFP58QgMXOTE1Fzh7MsPA== --osd-uuid d1d22331-d648-4df3-9d4e-ed29043c15b1 2026-02-13T05:54:48.102 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:48.101+0000 7fd295b59900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:48.103 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:48.103+0000 7fd295b59900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:48.104 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:48.104+0000 7fd295b59900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:48.105 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:48.104+0000 7fd295b59900 -1 bdev(0x55dbd445ec00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:48.105 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:48.104+0000 7fd295b59900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T05:54:48.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T05:54:48.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:48.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T05:54:48.446 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T05:54:48.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:48.761 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:54:48.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T05:54:48.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:48.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:48.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:48.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:48.780 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:48.780+0000 7fe7dc067900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:48.782 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:48.781+0000 7fe7dc067900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:48.783 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:48.782+0000 7fe7dc067900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:48.928 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:48.928+0000 7fe7dc067900 -1 Falling back to public interface 2026-02-13T05:54:48.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T05:54:48.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:48.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:54:48.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:48.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:48.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:48.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:48.986 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:48.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:48.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:54:49.212 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:49.279 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:49.278+0000 7fe7dc067900 -1 osd.3 0 log_to_monitors true 2026-02-13T05:54:50.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:50.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:50.214 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:50.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:50.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:50.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:54:50.447 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 27 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/593634563,v1:127.0.0.1:6827/593634563] [v2:127.0.0.1:6828/593634563,v1:127.0.0.1:6829/593634563] exists,up d1d22331-d648-4df3-9d4e-ed29043c15b1 2026-02-13T05:54:50.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:50.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:50.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:50.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:50.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-13T05:54:50.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:50.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:50.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-13T05:54:50.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:50.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-13T05:54:50.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:54:50.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:50.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:50.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:50.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-13T05:54:50.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-13T05:54:50.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:50.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:50.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:50.452 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:50.452 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:50.452 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:50.452 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:50.453 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:50.453 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:50.453 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:50.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:50.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:50.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:50.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:50.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:50.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:50.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:50.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:50.453 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:50.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:50.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:50.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:50.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-13T05:54:50.454 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:50.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=de511f08-f628-49d7-b82d-157f29c2ae5c 2026-02-13T05:54:50.455 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 de511f08-f628-49d7-b82d-157f29c2ae5c' 2026-02-13T05:54:50.455 INFO:tasks.workunit.client.0.trial024.stdout:add osd4 de511f08-f628-49d7-b82d-157f29c2ae5c 2026-02-13T05:54:50.455 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:50.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCqvI5p73KnGxAAnzANmWmb9UaP3tvAQBeaMw== 2026-02-13T05:54:50.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCqvI5p73KnGxAAnzANmWmb9UaP3tvAQBeaMw=="}' 2026-02-13T05:54:50.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new de511f08-f628-49d7-b82d-157f29c2ae5c -i td/test-erasure-eio/4/new.json 2026-02-13T05:54:50.698 INFO:tasks.workunit.client.0.trial024.stdout:4 2026-02-13T05:54:50.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-13T05:54:50.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCqvI5p73KnGxAAnzANmWmb9UaP3tvAQBeaMw== --osd-uuid de511f08-f628-49d7-b82d-157f29c2ae5c 2026-02-13T05:54:50.726 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:50.726+0000 7fba93983900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:50.728 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:50.727+0000 7fba93983900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:50.729 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:50.728+0000 7fba93983900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:50.729 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:50.728+0000 7fba93983900 -1 bdev(0x55b7a7fb6c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:50.729 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:50.728+0000 7fba93983900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-13T05:54:51.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-13T05:54:51.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:51.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-13T05:54:51.052 INFO:tasks.workunit.client.0.trial024.stdout:adding osd4 key to auth repository 2026-02-13T05:54:51.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:51.375 INFO:tasks.workunit.client.0.trial024.stdout:start osd.4 2026-02-13T05:54:51.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-13T05:54:51.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:51.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:51.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:51.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:51.394 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:51.393+0000 7fa3ccc11900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:51.395 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:51.395+0000 7fa3ccc11900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:51.396 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:51.396+0000 7fa3ccc11900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:51.525 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:51.524+0000 7fa3ccc11900 -1 Falling back to public interface 2026-02-13T05:54:51.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-13T05:54:51.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:51.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-13T05:54:51.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:51.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:51.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:51.603 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:51.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:51.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:51.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:54:51.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:51.889 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:51.889+0000 7fa3ccc11900 -1 osd.4 0 log_to_monitors true 2026-02-13T05:54:52.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:52.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:52.830 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:52.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:52.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:52.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:54:53.056 INFO:tasks.workunit.client.0.trial024.stdout:osd.4 up in weight 1 up_from 36 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3067770662,v1:127.0.0.1:6835/3067770662] [v2:127.0.0.1:6836/3067770662,v1:127.0.0.1:6837/3067770662] exists,up de511f08-f628-49d7-b82d-157f29c2ae5c 2026-02-13T05:54:53.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:53.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:53.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:53.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:53.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-13T05:54:53.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:53.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:53.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-13T05:54:53.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:53.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-13T05:54:53.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:54:53.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:53.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:53.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:53.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-13T05:54:53.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-13T05:54:53.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:53.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:53.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:53.061 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:53.061 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:53.061 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:53.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:53.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:53.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:53.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:53.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-13T05:54:53.063 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:53.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d927ce92-bade-4c92-bdcc-871157d15fb5 2026-02-13T05:54:53.064 INFO:tasks.workunit.client.0.trial024.stdout:add osd5 d927ce92-bade-4c92-bdcc-871157d15fb5 2026-02-13T05:54:53.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 d927ce92-bade-4c92-bdcc-871157d15fb5' 2026-02-13T05:54:53.064 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:53.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCtvI5pagBXBBAASXx5GLp6DQSj/i0Wij4H9Q== 2026-02-13T05:54:53.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCtvI5pagBXBBAASXx5GLp6DQSj/i0Wij4H9Q=="}' 2026-02-13T05:54:53.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d927ce92-bade-4c92-bdcc-871157d15fb5 -i td/test-erasure-eio/5/new.json 2026-02-13T05:54:53.303 INFO:tasks.workunit.client.0.trial024.stdout:5 2026-02-13T05:54:53.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-13T05:54:53.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCtvI5pagBXBBAASXx5GLp6DQSj/i0Wij4H9Q== --osd-uuid d927ce92-bade-4c92-bdcc-871157d15fb5 2026-02-13T05:54:53.331 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:53.331+0000 7f9833b03900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:53.332 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:53.332+0000 7f9833b03900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:53.333 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:53.333+0000 7f9833b03900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:53.334 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:53.333+0000 7f9833b03900 -1 bdev(0x55a7a17b8c00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:53.334 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:53.333+0000 7f9833b03900 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-13T05:54:53.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-13T05:54:53.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:53.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-13T05:54:53.651 INFO:tasks.workunit.client.0.trial024.stdout:adding osd5 key to auth repository 2026-02-13T05:54:53.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:53.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-13T05:54:53.965 INFO:tasks.workunit.client.0.trial024.stdout:start osd.5 2026-02-13T05:54:53.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:53.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:53.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:53.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:53.983 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:53.982+0000 7fac64617900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:53.984 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:53.984+0000 7fac64617900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:53.985 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:53.984+0000 7fac64617900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:54.105 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:54.104+0000 7fac64617900 -1 Falling back to public interface 2026-02-13T05:54:54.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-13T05:54:54.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:54.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-13T05:54:54.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:54.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:54.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:54.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:54.193 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:54.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:54.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:54:54.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:54.436 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:54.436+0000 7fac64617900 -1 osd.5 0 log_to_monitors true 2026-02-13T05:54:55.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:55.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:55.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:55.425 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:55.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:55.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:54:55.650 INFO:tasks.workunit.client.0.trial024.stdout:osd.5 up in weight 1 up_from 44 up_thru 45 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3202121109,v1:127.0.0.1:6843/3202121109] [v2:127.0.0.1:6844/3202121109,v1:127.0.0.1:6845/3202121109] exists,up d927ce92-bade-4c92-bdcc-871157d15fb5 2026-02-13T05:54:55.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:55.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:55.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:54:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-13T05:54:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:54:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:54:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-13T05:54:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:54:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-13T05:54:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:54:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:54:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:54:55.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:54:55.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-13T05:54:55.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-13T05:54:55.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:54:55.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:54:55.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:54:55.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:54:55.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:54:55.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:54:55.655 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:54:55.655 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:55.655 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:55.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:54:55.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-13T05:54:55.657 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:54:55.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7290a666-cc30-4077-aa2d-24ec2ae4811b 2026-02-13T05:54:55.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 7290a666-cc30-4077-aa2d-24ec2ae4811b' 2026-02-13T05:54:55.657 INFO:tasks.workunit.client.0.trial024.stdout:add osd6 7290a666-cc30-4077-aa2d-24ec2ae4811b 2026-02-13T05:54:55.657 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:54:55.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCvvI5peJyqJxAAFKs/xaeF0zC0VSZ+ehcR1g== 2026-02-13T05:54:55.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCvvI5peJyqJxAAFKs/xaeF0zC0VSZ+ehcR1g=="}' 2026-02-13T05:54:55.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7290a666-cc30-4077-aa2d-24ec2ae4811b -i td/test-erasure-eio/6/new.json 2026-02-13T05:54:55.904 INFO:tasks.workunit.client.0.trial024.stdout:6 2026-02-13T05:54:55.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-13T05:54:55.912 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCvvI5peJyqJxAAFKs/xaeF0zC0VSZ+ehcR1g== --osd-uuid 7290a666-cc30-4077-aa2d-24ec2ae4811b 2026-02-13T05:54:55.932 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:55.931+0000 7fecd220f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:55.933 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:55.933+0000 7fecd220f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:55.934 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:55.934+0000 7fecd220f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:55.935 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:55.934+0000 7fecd220f900 -1 bdev(0x55f2436e0c00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-13T05:54:55.935 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:55.934+0000 7fecd220f900 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-13T05:54:56.248 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-13T05:54:56.248 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:54:56.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-13T05:54:56.250 INFO:tasks.workunit.client.0.trial024.stdout:adding osd6 key to auth repository 2026-02-13T05:54:56.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:54:56.566 INFO:tasks.workunit.client.0.trial024.stdout:start osd.6 2026-02-13T05:54:56.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-13T05:54:56.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:54:56.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:54:56.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:54:56.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:54:56.585 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:56.584+0000 7fe87291a900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:56.586 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:56.586+0000 7fe87291a900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:56.587 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:56.587+0000 7fe87291a900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:54:56.726 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:56.725+0000 7fe87291a900 -1 Falling back to public interface 2026-02-13T05:54:56.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-13T05:54:56.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:54:56.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-13T05:54:56.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:54:56.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:54:56.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:56.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:54:56.797 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:54:56.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:56.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:54:57.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:54:57.088 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:54:57.088+0000 7fe87291a900 -1 osd.6 0 log_to_monitors true 2026-02-13T05:54:58.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:54:58.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:54:58.025 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:54:58.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:54:58.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:54:58.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:54:58.253 INFO:tasks.workunit.client.0.trial024.stdout:osd.6 up in weight 1 up_from 52 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/1570325692,v1:127.0.0.1:6851/1570325692] [v2:127.0.0.1:6852/1570325692,v1:127.0.0.1:6853/1570325692] exists,up 7290a666-cc30-4077-aa2d-24ec2ae4811b 2026-02-13T05:54:58.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:54:58.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:54:58.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:54:58.255 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T05:54:58.255 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:54:58.255 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:54:58.256 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:54:58.256 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:54:58.256 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:54:58.256 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:54:58.256 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T05:54:58.256 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T05:54:58.301 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:54:58.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T05:54:58.307 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:54:41.419+0000 7f856a65d900 0 load: jerasure load: lrc 2026-02-13T05:54:58.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:477: TEST_ec_recovery_multiple_objects: CEPH_ARGS='--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:54:58.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:479: TEST_ec_recovery_multiple_objects: local poolname=pool-jerasure 2026-02-13T05:54:58.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:480: TEST_ec_recovery_multiple_objects: create_erasure_coded_pool pool-jerasure 3 2 2026-02-13T05:54:58.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:54:58.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T05:54:58.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-13T05:54:58.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T05:54:58.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-13T05:54:58.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T05:54:58.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-13T05:54:58.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T05:54:58.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T05:54:58.965 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T05:54:58.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:54:59.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T05:54:59.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:54:59.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:54:59.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:54:59.976 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:54:59.977 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:54:59.977 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:54:59.977 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:54:59.977 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:54:59.977 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:55:00.060 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:55:00.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:55:00.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:55:00.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:55:00.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:55:00.061 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:55:00.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:55:00.291 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:55:00.291 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:55:00.292 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:55:00.292 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:55:00.292 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:55:00.292 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:55:00.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:55:00.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:00.292 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:55:00.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803782 2026-02-13T05:55:00.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803782 2026-02-13T05:55:00.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782' 2026-02-13T05:55:00.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:00.359 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:55:00.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-13T05:55:00.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-13T05:55:00.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854' 2026-02-13T05:55:00.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:00.424 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:55:00.487 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378629 2026-02-13T05:55:00.487 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378629 2026-02-13T05:55:00.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629' 2026-02-13T05:55:00.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:00.488 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:55:00.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116997 2026-02-13T05:55:00.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116997 2026-02-13T05:55:00.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629 3-115964116997' 2026-02-13T05:55:00.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:00.551 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:55:00.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822661 2026-02-13T05:55:00.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822661 2026-02-13T05:55:00.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629 3-115964116997 4-154618822661' 2026-02-13T05:55:00.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:00.615 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:55:00.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561029 2026-02-13T05:55:00.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561029 2026-02-13T05:55:00.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629 3-115964116997 4-154618822661 5-188978561029' 2026-02-13T05:55:00.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:00.681 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:55:00.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=223338299395 2026-02-13T05:55:00.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 223338299395 2026-02-13T05:55:00.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-55834574854 2-81604378629 3-115964116997 4-154618822661 5-188978561029 6-223338299395' 2026-02-13T05:55:00.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:00.748 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803782 2026-02-13T05:55:00.748 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:00.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:55:00.749 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803782 2026-02-13T05:55:00.749 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:00.750 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803782 2026-02-13T05:55:00.750 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803782 2026-02-13T05:55:00.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803782' 2026-02-13T05:55:00.751 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:55:00.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803780 -lt 25769803782 2026-02-13T05:55:00.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:55:01.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:55:01.973 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:55:02.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803782 2026-02-13T05:55:02.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:02.197 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574854 2026-02-13T05:55:02.197 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:02.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:55:02.199 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574854 2026-02-13T05:55:02.199 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:02.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574854 2026-02-13T05:55:02.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574854' 2026-02-13T05:55:02.200 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 55834574854 2026-02-13T05:55:02.200 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:55:02.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-13T05:55:02.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:02.425 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378629 2026-02-13T05:55:02.425 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:02.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:55:02.427 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378629 2026-02-13T05:55:02.427 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:02.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378629 2026-02-13T05:55:02.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378629' 2026-02-13T05:55:02.428 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 81604378629 2026-02-13T05:55:02.429 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:55:02.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378629 -lt 81604378629 2026-02-13T05:55:02.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:02.649 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116997 2026-02-13T05:55:02.649 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:02.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:55:02.651 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116997 2026-02-13T05:55:02.651 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:02.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116997 2026-02-13T05:55:02.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116997' 2026-02-13T05:55:02.652 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 115964116997 2026-02-13T05:55:02.652 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:55:02.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116997 -lt 115964116997 2026-02-13T05:55:02.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:02.879 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-154618822661 2026-02-13T05:55:02.879 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:02.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:55:02.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-154618822661 2026-02-13T05:55:02.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:02.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822661 2026-02-13T05:55:02.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 154618822661' 2026-02-13T05:55:02.882 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 154618822661 2026-02-13T05:55:02.882 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:55:03.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822661 -lt 154618822661 2026-02-13T05:55:03.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:03.115 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-188978561029 2026-02-13T05:55:03.115 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:03.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:55:03.116 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-188978561029 2026-02-13T05:55:03.116 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:03.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=188978561029 2026-02-13T05:55:03.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 188978561029' 2026-02-13T05:55:03.118 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 188978561029 2026-02-13T05:55:03.118 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:55:03.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 188978561029 -lt 188978561029 2026-02-13T05:55:03.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:03.342 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-223338299395 2026-02-13T05:55:03.342 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:03.343 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:55:03.344 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-223338299395 2026-02-13T05:55:03.344 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:03.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=223338299395 2026-02-13T05:55:03.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 223338299395' 2026-02-13T05:55:03.345 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 223338299395 2026-02-13T05:55:03.346 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:55:03.571 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 223338299396 -lt 223338299395 2026-02-13T05:55:03.572 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:55:03.572 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:55:03.572 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:55:03.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:55:03.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:55:03.883 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:55:03.883 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:55:03.883 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:55:03.883 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:55:03.883 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:55:03.883 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:55:04.104 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:55:04.105 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:55:04.105 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:55:04.105 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:55:04.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:55:04.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:55:04.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:55:04.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:482: TEST_ec_recovery_multiple_objects: rados_put td/test-erasure-eio pool-jerasure test1 2026-02-13T05:55:04.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:55:04.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:55:04.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test1 2026-02-13T05:55:04.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:04.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:55:04.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:04.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:55:04.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:04.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:55:04.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:04.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:55:04.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test1 td/test-erasure-eio/ORIGINAL 2026-02-13T05:55:04.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:483: TEST_ec_recovery_multiple_objects: rados_put td/test-erasure-eio pool-jerasure test2 2026-02-13T05:55:04.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:55:04.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:55:04.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test2 2026-02-13T05:55:04.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:04.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:55:04.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:04.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:55:04.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:04.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:55:04.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:04.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:55:04.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test2 td/test-erasure-eio/ORIGINAL 2026-02-13T05:55:04.458 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:484: TEST_ec_recovery_multiple_objects: rados_put td/test-erasure-eio pool-jerasure test3 2026-02-13T05:55:04.458 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:55:04.458 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:55:04.458 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test3 2026-02-13T05:55:04.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:04.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:55:04.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:04.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:55:04.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:04.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:55:04.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:04.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:55:04.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test3 td/test-erasure-eio/ORIGINAL 2026-02-13T05:55:04.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:486: TEST_ec_recovery_multiple_objects: ceph osd out 0 2026-02-13T05:55:04.751 INFO:tasks.workunit.client.0.trial024.stderr:osd.0 is already out. 2026-02-13T05:55:04.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:489: TEST_ec_recovery_multiple_objects: wait_for_clean 2026-02-13T05:55:04.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:55:04.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:55:04.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:55:04.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:55:04.761 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:55:04.761 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:55:04.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:55:04.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:55:04.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:55:04.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:55:04.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:55:04.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:55:04.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:55:04.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:55:04.846 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:55:05.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:55:05.075 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:55:05.075 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:55:05.075 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:55:05.075 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:55:05.075 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:55:05.075 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:55:05.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:55:05.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:05.076 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:55:05.142 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803785 2026-02-13T05:55:05.142 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803785 2026-02-13T05:55:05.142 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785' 2026-02-13T05:55:05.142 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:05.142 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:55:05.208 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-13T05:55:05.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-13T05:55:05.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857' 2026-02-13T05:55:05.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:05.209 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:55:05.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378632 2026-02-13T05:55:05.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378632 2026-02-13T05:55:05.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632' 2026-02-13T05:55:05.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:05.273 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:55:05.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116999 2026-02-13T05:55:05.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116999 2026-02-13T05:55:05.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632 3-115964116999' 2026-02-13T05:55:05.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:05.337 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:55:05.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822664 2026-02-13T05:55:05.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822664 2026-02-13T05:55:05.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632 3-115964116999 4-154618822664' 2026-02-13T05:55:05.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:05.402 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:55:05.467 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561031 2026-02-13T05:55:05.467 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561031 2026-02-13T05:55:05.468 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632 3-115964116999 4-154618822664 5-188978561031' 2026-02-13T05:55:05.468 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:05.468 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:55:05.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=223338299398 2026-02-13T05:55:05.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 223338299398 2026-02-13T05:55:05.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-55834574857 2-81604378632 3-115964116999 4-154618822664 5-188978561031 6-223338299398' 2026-02-13T05:55:05.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:05.533 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803785 2026-02-13T05:55:05.533 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:05.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:55:05.534 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803785 2026-02-13T05:55:05.534 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:05.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803785 2026-02-13T05:55:05.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-13T05:55:05.536 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803785 2026-02-13T05:55:05.536 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:55:05.759 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803785 -lt 25769803785 2026-02-13T05:55:05.759 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:05.760 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574857 2026-02-13T05:55:05.760 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:05.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:55:05.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574857 2026-02-13T05:55:05.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:05.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574857 2026-02-13T05:55:05.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574857' 2026-02-13T05:55:05.763 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 55834574857 2026-02-13T05:55:05.763 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:55:05.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-13T05:55:05.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:05.988 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378632 2026-02-13T05:55:05.988 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:05.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:55:05.989 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378632 2026-02-13T05:55:05.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:05.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378632 2026-02-13T05:55:05.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378632' 2026-02-13T05:55:05.991 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 81604378632 2026-02-13T05:55:05.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:55:06.215 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378632 -lt 81604378632 2026-02-13T05:55:06.215 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:06.216 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116999 2026-02-13T05:55:06.216 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:06.216 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:55:06.217 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116999 2026-02-13T05:55:06.217 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:06.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116999 2026-02-13T05:55:06.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116999' 2026-02-13T05:55:06.219 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 115964116999 2026-02-13T05:55:06.219 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:55:06.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116999 -lt 115964116999 2026-02-13T05:55:06.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:06.445 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-154618822664 2026-02-13T05:55:06.445 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:06.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:55:06.446 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-154618822664 2026-02-13T05:55:06.446 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:06.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822664 2026-02-13T05:55:06.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 154618822664' 2026-02-13T05:55:06.447 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 154618822664 2026-02-13T05:55:06.448 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:55:06.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822662 -lt 154618822664 2026-02-13T05:55:06.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:55:07.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:55:07.672 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:55:07.908 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822664 -lt 154618822664 2026-02-13T05:55:07.908 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:07.908 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-188978561031 2026-02-13T05:55:07.908 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:07.909 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:55:07.910 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-188978561031 2026-02-13T05:55:07.910 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:07.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=188978561031 2026-02-13T05:55:07.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 188978561031' 2026-02-13T05:55:07.911 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 188978561031 2026-02-13T05:55:07.911 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:55:08.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 188978561032 -lt 188978561031 2026-02-13T05:55:08.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:08.138 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-223338299398 2026-02-13T05:55:08.138 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:08.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:55:08.140 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-223338299398 2026-02-13T05:55:08.140 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:08.141 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=223338299398 2026-02-13T05:55:08.141 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 223338299398' 2026-02-13T05:55:08.141 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 223338299398 2026-02-13T05:55:08.142 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:55:08.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 223338299398 -lt 223338299398 2026-02-13T05:55:08.377 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:55:08.377 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:55:08.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:55:08.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:55:08.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:55:08.687 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:55:08.687 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:55:08.687 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:55:08.687 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:55:08.687 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:55:08.687 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:55:08.906 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:55:08.907 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:55:08.907 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:55:08.908 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:55:09.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:55:09.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:55:09.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:55:09.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:491: TEST_ec_recovery_multiple_objects: rados_get td/test-erasure-eio pool-jerasure test1 2026-02-13T05:55:09.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:55:09.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:55:09.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test1 2026-02-13T05:55:09.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:55:09.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:55:09.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test1 td/test-erasure-eio/COPY 2026-02-13T05:55:09.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:55:09.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:55:09.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:492: TEST_ec_recovery_multiple_objects: rados_get td/test-erasure-eio pool-jerasure test2 2026-02-13T05:55:09.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:55:09.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:55:09.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test2 2026-02-13T05:55:09.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:55:09.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:55:09.253 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test2 td/test-erasure-eio/COPY 2026-02-13T05:55:09.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:55:09.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:55:09.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:493: TEST_ec_recovery_multiple_objects: rados_get td/test-erasure-eio pool-jerasure test3 2026-02-13T05:55:09.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:55:09.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:55:09.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test3 2026-02-13T05:55:09.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:55:09.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:55:09.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test3 td/test-erasure-eio/COPY 2026-02-13T05:55:09.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:55:09.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:55:09.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:495: TEST_ec_recovery_multiple_objects: delete_erasure_coded_pool pool-jerasure 2026-02-13T05:55:09.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:55:09.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T05:55:09.531 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T05:55:09.540 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T05:55:09.815 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T05:55:09.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T05:55:09.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:55:09.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:55:09.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:55:09.823 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:55:09.823 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:55:09.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:55:09.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:55:09.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:55:09.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:55:09.934 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:55:09.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:55:09.935 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:55:09.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:55:09.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:55:09.937 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:55:09.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:55:09.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:55:09.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:55:09.939 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:55:09.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:55:09.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:55:09.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:55:09.955 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:55:09.955 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:09.955 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:09.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:55:09.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:55:09.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:55:09.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T05:55:09.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T05:55:09.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T05:55:09.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T05:55:09.958 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:55:09.958 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:55:09.958 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:55:09.958 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:55:09.958 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:55:09.958 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:55:09.958 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:55:09.958 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:55:09.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:55:09.959 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:55:09.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:55:09.960 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:55:09.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:55:09.961 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:55:09.961 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:55:09.961 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:55:09.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:55:09.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:55:09.962 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:55:09.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:55:09.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:55:09.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:55:09.965 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:55:09.965 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:09.965 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:09.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:55:09.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:55:09.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:55:09.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T05:55:09.967 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:55:09.967 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:09.967 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:09.968 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T05:55:09.968 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:55:09.969 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:55:09.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:55:09.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T05:55:09.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T05:55:09.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T05:55:09.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:55:09.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:55:09.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:55:09.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T05:55:09.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T05:55:09.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:55:09.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:09.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:09.990 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:09.990 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:09.990 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:09.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:09.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:55:10.017 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:55:10.018 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:55:10.019 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:55:10.019 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:55:10.019 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:55:10.019 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:55:10.019 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:55:10.019 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:55:10.019 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:55:10.020 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:55:10.020 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:10.020 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:10.020 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:55:10.020 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:55:10.020 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T05:55:10.064 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:55:10.064 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:55:10.064 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:55:10.064 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:55:10.064 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:55:10.066 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:55:10.066 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:55:10.066 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:55:10.066 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:55:10.066 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:10.066 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:10.066 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:55:10.066 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:55:10.066 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T05:55:10.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T05:55:10.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T05:55:10.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:55:10.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:55:10.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:55:10.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T05:55:10.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:55:10.214 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:55:10.214 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:10.214 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:10.215 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:10.215 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:10.215 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:10.215 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:10.215 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:55:10.216 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:55:10.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T05:55:10.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:55:10.329 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:55:10.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:55:11.337 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T05:55:11.338 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:55:11.338 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:55:11.338 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:55:11.338 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:11.338 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:11.338 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:55:11.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T05:55:11.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T05:55:11.379 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:55:11.384 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T05:55:11.385 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:55:10.008+0000 7f3789213d80 0 load: jerasure load: lrc 2026-02-13T05:55:11.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_recovery_multiple_objects_eio td/test-erasure-eio 2026-02-13T05:55:11.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:500: TEST_ec_recovery_multiple_objects_eio: local dir=td/test-erasure-eio 2026-02-13T05:55:11.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:501: TEST_ec_recovery_multiple_objects_eio: local objname=myobject 2026-02-13T05:55:11.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:503: TEST_ec_recovery_multiple_objects_eio: ORIG_ARGS='--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:55:11.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:504: TEST_ec_recovery_multiple_objects_eio: CEPH_ARGS+=' --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:55:11.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:505: TEST_ec_recovery_multiple_objects_eio: setup_osds 7 2026-02-13T05:55:11.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=7 2026-02-13T05:55:11.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T05:55:11.388 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 7 - 1 2026-02-13T05:55:11.392 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 6 2026-02-13T05:55:11.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:55:11.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T05:55:11.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:55:11.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:55:11.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:55:11.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:55:11.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T05:55:11.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:55:11.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:55:11.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:55:11.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:55:11.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T05:55:11.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T05:55:11.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:55:11.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:55:11.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:55:11.393 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:55:11.393 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:11.393 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:55:11.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:55:11.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:55:11.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:55:11.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:55:11.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T05:55:11.395 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:55:11.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=eef153d2-48bd-4067-bf45-6860aa8b9109 2026-02-13T05:55:11.395 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 eef153d2-48bd-4067-bf45-6860aa8b9109 2026-02-13T05:55:11.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 eef153d2-48bd-4067-bf45-6860aa8b9109' 2026-02-13T05:55:11.396 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:55:11.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC/vI5pmkobGBAAHccyLmqETOlqDpAf/MmssA== 2026-02-13T05:55:11.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC/vI5pmkobGBAAHccyLmqETOlqDpAf/MmssA=="}' 2026-02-13T05:55:11.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new eef153d2-48bd-4067-bf45-6860aa8b9109 -i td/test-erasure-eio/0/new.json 2026-02-13T05:55:11.511 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:11.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T05:55:11.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC/vI5pmkobGBAAHccyLmqETOlqDpAf/MmssA== --osd-uuid eef153d2-48bd-4067-bf45-6860aa8b9109 2026-02-13T05:55:11.539 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:11.537+0000 7f5b42622900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:11.540 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:11.539+0000 7f5b42622900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:11.541 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:11.540+0000 7f5b42622900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:11.541 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:11.540+0000 7f5b42622900 -1 bdev(0x55a11e300c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:55:11.542 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:11.540+0000 7f5b42622900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T05:55:11.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T05:55:11.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:55:11.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:55:11.988 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:55:11.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:55:12.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:55:12.095 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:55:12.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:55:12.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:55:12.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:55:12.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:55:12.114 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:12.112+0000 7f4a735ac900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:12.115 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:12.114+0000 7f4a735ac900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:12.116 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:12.115+0000 7f4a735ac900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:12.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:55:12.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:55:12.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:55:12.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:55:12.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:55:12.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:12.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:55:12.196 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:12.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:12.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:55:12.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:55:12.326 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:12.325+0000 7f4a735ac900 -1 Falling back to public interface 2026-02-13T05:55:12.608 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:12.606+0000 7f4a735ac900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:55:13.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:55:13.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:13.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:55:13.300 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:13.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:13.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:55:13.528 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1529815196,v1:127.0.0.1:6803/1529815196] [v2:127.0.0.1:6804/1529815196,v1:127.0.0.1:6805/1529815196] exists,up eef153d2-48bd-4067-bf45-6860aa8b9109 2026-02-13T05:55:13.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:55:13.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:55:13.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:55:13.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:55:13.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T05:55:13.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:55:13.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:55:13.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:55:13.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:55:13.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:55:13.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:55:13.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:55:13.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:55:13.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:55:13.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:55:13.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:55:13.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:55:13.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:55:13.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:55:13.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:55:13.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:55:13.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:55:13.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:55:13.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:55:13.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:55:13.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:55:13.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:55:13.535 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:55:13.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6db9929c-5d74-467e-b18e-8518f92defec 2026-02-13T05:55:13.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 6db9929c-5d74-467e-b18e-8518f92defec' 2026-02-13T05:55:13.536 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 6db9929c-5d74-467e-b18e-8518f92defec 2026-02-13T05:55:13.536 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:55:13.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDBvI5p/p12IBAAb7scHZRTBgnG++rKvCFJeg== 2026-02-13T05:55:13.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDBvI5p/p12IBAAb7scHZRTBgnG++rKvCFJeg=="}' 2026-02-13T05:55:13.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6db9929c-5d74-467e-b18e-8518f92defec -i td/test-erasure-eio/1/new.json 2026-02-13T05:55:13.783 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:13.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T05:55:13.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDBvI5p/p12IBAAb7scHZRTBgnG++rKvCFJeg== --osd-uuid 6db9929c-5d74-467e-b18e-8518f92defec 2026-02-13T05:55:13.812 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:13.811+0000 7f09a63c6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:13.814 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:13.812+0000 7f09a63c6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:13.815 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:13.813+0000 7f09a63c6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:13.815 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:13.814+0000 7f09a63c6900 -1 bdev(0x55f6b6a12c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:55:13.816 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:13.814+0000 7f09a63c6900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T05:55:14.159 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T05:55:14.159 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:55:14.159 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:55:14.160 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:55:14.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:55:14.478 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:55:14.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:55:14.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:55:14.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:55:14.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:55:14.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:55:14.497 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:14.495+0000 7f3cce60f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:14.498 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:14.497+0000 7f3cce60f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:14.499 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:14.498+0000 7f3cce60f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:14.637 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:14.635+0000 7f3cce60f900 -1 Falling back to public interface 2026-02-13T05:55:14.703 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:55:14.703 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:55:14.703 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:55:14.703 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:55:14.703 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:55:14.703 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:14.703 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:55:14.704 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:14.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:14.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:55:14.929 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:55:14.989 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:14.987+0000 7f3cce60f900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:55:15.930 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:55:15.930 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:15.930 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:15.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:55:15.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:15.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:55:16.160 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/389062489,v1:127.0.0.1:6811/389062489] [v2:127.0.0.1:6812/389062489,v1:127.0.0.1:6813/389062489] exists,up 6db9929c-5d74-467e-b18e-8518f92defec 2026-02-13T05:55:16.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:55:16.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:55:16.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:55:16.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:55:16.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T05:55:16.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:55:16.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:55:16.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:55:16.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:55:16.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:55:16.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:55:16.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:55:16.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:55:16.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:55:16.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:55:16.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:55:16.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:55:16.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:55:16.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:55:16.165 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:55:16.165 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:16.166 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:16.166 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:16.166 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:16.166 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:16.166 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:16.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:16.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:55:16.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:55:16.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:55:16.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:55:16.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:55:16.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:55:16.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:55:16.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:55:16.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:55:16.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:55:16.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:55:16.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:55:16.167 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:55:16.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b62e27cc-8460-428a-a554-5a9392ef6f47 2026-02-13T05:55:16.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 b62e27cc-8460-428a-a554-5a9392ef6f47' 2026-02-13T05:55:16.167 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 b62e27cc-8460-428a-a554-5a9392ef6f47 2026-02-13T05:55:16.168 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:55:16.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDEvI5pwJSEChAAOkRMr7g7mktaDeMgfW3shA== 2026-02-13T05:55:16.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDEvI5pwJSEChAAOkRMr7g7mktaDeMgfW3shA=="}' 2026-02-13T05:55:16.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b62e27cc-8460-428a-a554-5a9392ef6f47 -i td/test-erasure-eio/2/new.json 2026-02-13T05:55:16.405 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:55:16.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T05:55:16.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDEvI5pwJSEChAAOkRMr7g7mktaDeMgfW3shA== --osd-uuid b62e27cc-8460-428a-a554-5a9392ef6f47 2026-02-13T05:55:16.434 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:16.433+0000 7ff16d6f3900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:16.436 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:16.435+0000 7ff16d6f3900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:16.437 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:16.436+0000 7ff16d6f3900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:16.438 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:16.436+0000 7ff16d6f3900 -1 bdev(0x55cde57b0c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:55:16.438 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:16.436+0000 7ff16d6f3900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T05:55:16.758 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T05:55:16.758 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:55:16.759 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:55:16.759 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:55:16.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:55:17.075 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:55:17.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:55:17.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:55:17.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:55:17.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:55:17.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:55:17.094 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:17.092+0000 7f95afd3d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:17.095 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:17.094+0000 7f95afd3d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:17.096 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:17.095+0000 7f95afd3d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:17.255 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:17.254+0000 7f95afd3d900 -1 Falling back to public interface 2026-02-13T05:55:17.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:55:17.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:55:17.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:55:17.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:55:17.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:55:17.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:17.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:55:17.302 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:17.302 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:17.302 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:55:17.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:55:17.583 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:17.582+0000 7f95afd3d900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:55:18.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:55:18.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:18.529 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:18.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:55:18.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:18.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:55:18.762 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/386847050,v1:127.0.0.1:6819/386847050] [v2:127.0.0.1:6820/386847050,v1:127.0.0.1:6821/386847050] exists,up b62e27cc-8460-428a-a554-5a9392ef6f47 2026-02-13T05:55:18.766 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:55:18.766 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:55:18.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:55:18.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:55:18.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T05:55:18.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:55:18.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:55:18.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T05:55:18.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:55:18.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:55:18.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:55:18.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:55:18.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:55:18.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:55:18.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:55:18.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:55:18.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:55:18.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:55:18.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:55:18.768 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:55:18.768 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:18.768 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:18.768 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:18.768 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:18.768 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:18.768 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:55:18.769 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:55:18.770 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:55:18.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5d38f31a-8312-4949-9b1e-67ba8a35f9f4 2026-02-13T05:55:18.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 5d38f31a-8312-4949-9b1e-67ba8a35f9f4' 2026-02-13T05:55:18.770 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 5d38f31a-8312-4949-9b1e-67ba8a35f9f4 2026-02-13T05:55:18.770 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:55:18.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDGvI5p0r5sLhAAKjFFim5zkBftkEoyGJyAJg== 2026-02-13T05:55:18.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDGvI5p0r5sLhAAKjFFim5zkBftkEoyGJyAJg=="}' 2026-02-13T05:55:18.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5d38f31a-8312-4949-9b1e-67ba8a35f9f4 -i td/test-erasure-eio/3/new.json 2026-02-13T05:55:19.017 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T05:55:19.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T05:55:19.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDGvI5p0r5sLhAAKjFFim5zkBftkEoyGJyAJg== --osd-uuid 5d38f31a-8312-4949-9b1e-67ba8a35f9f4 2026-02-13T05:55:19.047 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:19.045+0000 7f1b18c0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:19.048 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:19.047+0000 7f1b18c0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:19.049 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:19.048+0000 7f1b18c0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:19.050 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:19.048+0000 7f1b18c0d900 -1 bdev(0x55ffa5c5cc00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T05:55:19.050 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:19.048+0000 7f1b18c0d900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T05:55:19.384 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T05:55:19.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:55:19.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T05:55:19.385 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T05:55:19.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:55:19.699 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:55:19.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T05:55:19.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:55:19.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:55:19.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:55:19.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:55:19.718 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:19.717+0000 7f4211fc8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:19.720 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:19.718+0000 7f4211fc8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:19.721 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:19.719+0000 7f4211fc8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:19.844 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:19.842+0000 7f4211fc8900 -1 Falling back to public interface 2026-02-13T05:55:19.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T05:55:19.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:55:19.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:55:19.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:55:19.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:55:19.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:19.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:55:19.925 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:19.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:19.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:55:20.153 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:20.151+0000 7f4211fc8900 -1 osd.3 0 log_to_monitors true 2026-02-13T05:55:20.161 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:55:21.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:55:21.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:21.163 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:21.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:55:21.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:21.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:55:21.388 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 27 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2535705234,v1:127.0.0.1:6827/2535705234] [v2:127.0.0.1:6828/2535705234,v1:127.0.0.1:6829/2535705234] exists,up 5d38f31a-8312-4949-9b1e-67ba8a35f9f4 2026-02-13T05:55:21.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:55:21.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:55:21.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:55:21.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:55:21.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-13T05:55:21.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:55:21.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:55:21.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-13T05:55:21.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:55:21.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-13T05:55:21.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:55:21.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:55:21.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:55:21.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:55:21.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-13T05:55:21.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-13T05:55:21.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:55:21.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:55:21.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:55:21.394 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:55:21.394 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:21.394 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:21.394 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:21.394 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:21.394 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:21.394 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:21.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:21.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:55:21.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:55:21.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:55:21.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:55:21.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:55:21.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:55:21.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:55:21.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:55:21.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:55:21.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:55:21.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:55:21.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-13T05:55:21.395 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:55:21.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cf6ec81a-369f-434c-ab72-6b74e3c3058a 2026-02-13T05:55:21.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 cf6ec81a-369f-434c-ab72-6b74e3c3058a' 2026-02-13T05:55:21.396 INFO:tasks.workunit.client.0.trial024.stdout:add osd4 cf6ec81a-369f-434c-ab72-6b74e3c3058a 2026-02-13T05:55:21.396 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:55:21.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDJvI5pHrYbGBAAJqyuAVvbG2yHDh4vLaL/iw== 2026-02-13T05:55:21.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDJvI5pHrYbGBAAJqyuAVvbG2yHDh4vLaL/iw=="}' 2026-02-13T05:55:21.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cf6ec81a-369f-434c-ab72-6b74e3c3058a -i td/test-erasure-eio/4/new.json 2026-02-13T05:55:21.646 INFO:tasks.workunit.client.0.trial024.stdout:4 2026-02-13T05:55:21.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-13T05:55:21.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDJvI5pHrYbGBAAJqyuAVvbG2yHDh4vLaL/iw== --osd-uuid cf6ec81a-369f-434c-ab72-6b74e3c3058a 2026-02-13T05:55:21.674 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:21.673+0000 7f17975a7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:21.676 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:21.674+0000 7f17975a7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:21.677 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:21.675+0000 7f17975a7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:21.677 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:21.675+0000 7f17975a7900 -1 bdev(0x55f07472ec00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-13T05:55:21.677 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:21.675+0000 7f17975a7900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-13T05:55:22.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-13T05:55:22.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:55:22.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-13T05:55:22.002 INFO:tasks.workunit.client.0.trial024.stdout:adding osd4 key to auth repository 2026-02-13T05:55:22.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:55:22.321 INFO:tasks.workunit.client.0.trial024.stdout:start osd.4 2026-02-13T05:55:22.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-13T05:55:22.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:55:22.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:55:22.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:55:22.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:55:22.341 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:22.339+0000 7fabdb2b4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:22.342 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:22.340+0000 7fabdb2b4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:22.343 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:22.341+0000 7fabdb2b4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:22.473 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:22.471+0000 7fabdb2b4900 -1 Falling back to public interface 2026-02-13T05:55:22.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-13T05:55:22.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:55:22.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-13T05:55:22.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:55:22.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:55:22.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:22.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:55:22.546 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:22.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:22.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:55:22.772 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:22.771+0000 7fabdb2b4900 -1 osd.4 0 log_to_monitors true 2026-02-13T05:55:22.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:55:23.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:55:23.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:23.776 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:23.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:55:23.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:23.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:55:24.009 INFO:tasks.workunit.client.0.trial024.stdout:osd.4 up in weight 1 up_from 36 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/315161440,v1:127.0.0.1:6835/315161440] [v2:127.0.0.1:6836/315161440,v1:127.0.0.1:6837/315161440] exists,up cf6ec81a-369f-434c-ab72-6b74e3c3058a 2026-02-13T05:55:24.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:55:24.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:55:24.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:55:24.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:55:24.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-13T05:55:24.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:55:24.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:55:24.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-13T05:55:24.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:55:24.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-13T05:55:24.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:55:24.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:55:24.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:55:24.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:55:24.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-13T05:55:24.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-13T05:55:24.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:55:24.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:55:24.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:55:24.014 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:55:24.014 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:24.014 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:55:24.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:55:24.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:55:24.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:55:24.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:55:24.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-13T05:55:24.016 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:55:24.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e809ebb7-cc6e-45dc-861a-df35a9165136 2026-02-13T05:55:24.017 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 e809ebb7-cc6e-45dc-861a-df35a9165136' 2026-02-13T05:55:24.017 INFO:tasks.workunit.client.0.trial024.stdout:add osd5 e809ebb7-cc6e-45dc-861a-df35a9165136 2026-02-13T05:55:24.017 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:55:24.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDMvI5p4/6PARAAJ9dtLBI6NF1m8lsHOxbn8g== 2026-02-13T05:55:24.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDMvI5p4/6PARAAJ9dtLBI6NF1m8lsHOxbn8g=="}' 2026-02-13T05:55:24.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e809ebb7-cc6e-45dc-861a-df35a9165136 -i td/test-erasure-eio/5/new.json 2026-02-13T05:55:24.252 INFO:tasks.workunit.client.0.trial024.stdout:5 2026-02-13T05:55:24.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-13T05:55:24.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDMvI5p4/6PARAAJ9dtLBI6NF1m8lsHOxbn8g== --osd-uuid e809ebb7-cc6e-45dc-861a-df35a9165136 2026-02-13T05:55:24.281 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:24.280+0000 7fa1acad0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:24.283 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:24.282+0000 7fa1acad0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:24.284 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:24.283+0000 7fa1acad0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:24.284 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:24.283+0000 7fa1acad0900 -1 bdev(0x5578d4caac00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-13T05:55:24.284 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:24.283+0000 7fa1acad0900 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-13T05:55:24.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-13T05:55:24.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:55:24.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-13T05:55:24.606 INFO:tasks.workunit.client.0.trial024.stdout:adding osd5 key to auth repository 2026-02-13T05:55:24.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:55:24.923 INFO:tasks.workunit.client.0.trial024.stdout:start osd.5 2026-02-13T05:55:24.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-13T05:55:24.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:55:24.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:55:24.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:55:24.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:55:24.946 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:24.945+0000 7f5ce8a15900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:24.947 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:24.946+0000 7f5ce8a15900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:24.948 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:24.947+0000 7f5ce8a15900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:25.072 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:25.071+0000 7f5ce8a15900 -1 Falling back to public interface 2026-02-13T05:55:25.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-13T05:55:25.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:55:25.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-13T05:55:25.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:55:25.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:55:25.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:25.151 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:25.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:55:25.152 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:25.152 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:55:25.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:55:25.390 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:25.389+0000 7f5ce8a15900 -1 osd.5 0 log_to_monitors true 2026-02-13T05:55:26.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:55:26.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:26.379 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:26.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:55:26.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:26.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:55:26.633 INFO:tasks.workunit.client.0.trial024.stdout:osd.5 up in weight 1 up_from 44 up_thru 46 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/1393516974,v1:127.0.0.1:6843/1393516974] [v2:127.0.0.1:6844/1393516974,v1:127.0.0.1:6845/1393516974] exists,up e809ebb7-cc6e-45dc-861a-df35a9165136 2026-02-13T05:55:26.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:55:26.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:55:26.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:55:26.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:55:26.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-13T05:55:26.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:55:26.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:55:26.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-13T05:55:26.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:55:26.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-13T05:55:26.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:55:26.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:55:26.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:55:26.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:55:26.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-13T05:55:26.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-13T05:55:26.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:55:26.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:55:26.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:55:26.639 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:55:26.639 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:26.639 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:26.640 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:26.640 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:26.640 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:26.640 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:26.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:26.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:55:26.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:55:26.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:55:26.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:55:26.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:55:26.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:55:26.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:55:26.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:55:26.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:55:26.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:55:26.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:55:26.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-13T05:55:26.641 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:55:26.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a505c0da-e23d-4135-b98b-bf37f55580f5 2026-02-13T05:55:26.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 a505c0da-e23d-4135-b98b-bf37f55580f5' 2026-02-13T05:55:26.641 INFO:tasks.workunit.client.0.trial024.stdout:add osd6 a505c0da-e23d-4135-b98b-bf37f55580f5 2026-02-13T05:55:26.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:55:26.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDOvI5pyUy9JhAAjRyC0vsBOFxLnxkavknQCA== 2026-02-13T05:55:26.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDOvI5pyUy9JhAAjRyC0vsBOFxLnxkavknQCA=="}' 2026-02-13T05:55:26.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a505c0da-e23d-4135-b98b-bf37f55580f5 -i td/test-erasure-eio/6/new.json 2026-02-13T05:55:26.877 INFO:tasks.workunit.client.0.trial024.stdout:6 2026-02-13T05:55:26.885 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-13T05:55:26.885 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDOvI5pyUy9JhAAjRyC0vsBOFxLnxkavknQCA== --osd-uuid a505c0da-e23d-4135-b98b-bf37f55580f5 2026-02-13T05:55:26.904 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:26.904+0000 7f1920a10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:26.906 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:26.905+0000 7f1920a10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:26.907 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:26.906+0000 7f1920a10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:26.908 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:26.907+0000 7f1920a10900 -1 bdev(0x5578e2484c00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-13T05:55:26.908 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:26.907+0000 7f1920a10900 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-13T05:55:27.248 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-13T05:55:27.248 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:55:27.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-13T05:55:27.249 INFO:tasks.workunit.client.0.trial024.stdout:adding osd6 key to auth repository 2026-02-13T05:55:27.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:55:27.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-13T05:55:27.590 INFO:tasks.workunit.client.0.trial024.stdout:start osd.6 2026-02-13T05:55:27.591 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:55:27.591 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:55:27.591 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:55:27.591 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:55:27.608 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:27.607+0000 7f44dfe10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:27.609 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:27.608+0000 7f44dfe10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:27.610 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:27.609+0000 7f44dfe10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:27.756 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:27.755+0000 7f44dfe10900 -1 Falling back to public interface 2026-02-13T05:55:27.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-13T05:55:27.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:55:27.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-13T05:55:27.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:55:27.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:55:27.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:27.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:55:27.815 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:27.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:27.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:55:28.042 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:55:28.062 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:28.062+0000 7f44dfe10900 -1 osd.6 0 log_to_monitors true 2026-02-13T05:55:29.043 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:55:29.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:29.044 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:29.045 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:55:29.045 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:29.045 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:55:29.268 INFO:tasks.workunit.client.0.trial024.stdout:osd.6 up in weight 1 up_from 51 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/2493944660,v1:127.0.0.1:6851/2493944660] [v2:127.0.0.1:6852/2493944660,v1:127.0.0.1:6853/2493944660] exists,up a505c0da-e23d-4135-b98b-bf37f55580f5 2026-02-13T05:55:29.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:55:29.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:55:29.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:55:29.270 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T05:55:29.270 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:55:29.270 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:55:29.270 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:55:29.270 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:29.271 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:29.271 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:55:29.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T05:55:29.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T05:55:29.316 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:55:29.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T05:55:29.322 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:55:12.327+0000 7f4a735ac900 0 load: jerasure load: lrc 2026-02-13T05:55:29.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:506: TEST_ec_recovery_multiple_objects_eio: CEPH_ARGS='--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:55:29.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:508: TEST_ec_recovery_multiple_objects_eio: local poolname=pool-jerasure 2026-02-13T05:55:29.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:509: TEST_ec_recovery_multiple_objects_eio: create_erasure_coded_pool pool-jerasure 3 2 2026-02-13T05:55:29.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:55:29.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T05:55:29.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-13T05:55:29.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T05:55:29.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-13T05:55:29.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T05:55:29.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-13T05:55:29.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T05:55:29.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T05:55:29.968 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T05:55:29.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:55:30.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T05:55:30.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:55:30.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:55:30.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:55:30.978 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:55:30.979 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:55:30.979 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:55:30.979 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:55:30.980 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:55:30.980 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:55:31.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:55:31.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:55:31.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:55:31.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:55:31.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:55:31.065 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:55:31.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:55:31.293 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:55:31.293 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:55:31.293 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:55:31.293 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:55:31.293 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:55:31.293 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:55:31.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:55:31.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:31.294 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:55:31.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803782 2026-02-13T05:55:31.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803782 2026-02-13T05:55:31.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782' 2026-02-13T05:55:31.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:31.360 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:55:31.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607558 2026-02-13T05:55:31.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607558 2026-02-13T05:55:31.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558' 2026-02-13T05:55:31.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:31.425 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:55:31.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411333 2026-02-13T05:55:31.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411333 2026-02-13T05:55:31.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-77309411333' 2026-02-13T05:55:31.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:31.488 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:55:31.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116997 2026-02-13T05:55:31.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116997 2026-02-13T05:55:31.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-77309411333 3-115964116997' 2026-02-13T05:55:31.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:31.554 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:55:31.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822661 2026-02-13T05:55:31.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822661 2026-02-13T05:55:31.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-77309411333 3-115964116997 4-154618822661' 2026-02-13T05:55:31.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:31.618 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:55:31.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561028 2026-02-13T05:55:31.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561028 2026-02-13T05:55:31.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-77309411333 3-115964116997 4-154618822661 5-188978561028' 2026-02-13T05:55:31.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:31.683 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:55:31.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=219043332099 2026-02-13T05:55:31.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 219043332099 2026-02-13T05:55:31.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-77309411333 3-115964116997 4-154618822661 5-188978561028 6-219043332099' 2026-02-13T05:55:31.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:31.747 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803782 2026-02-13T05:55:31.747 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:31.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:55:31.748 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803782 2026-02-13T05:55:31.749 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:31.750 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803782 2026-02-13T05:55:31.750 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803782' 2026-02-13T05:55:31.750 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803782 2026-02-13T05:55:31.750 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:55:31.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803780 -lt 25769803782 2026-02-13T05:55:31.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:55:32.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:55:32.975 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:55:33.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803782 2026-02-13T05:55:33.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:33.196 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607558 2026-02-13T05:55:33.197 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:33.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:55:33.198 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607558 2026-02-13T05:55:33.198 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:33.199 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607558 2026-02-13T05:55:33.199 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607558' 2026-02-13T05:55:33.199 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607558 2026-02-13T05:55:33.199 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:55:33.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607558 -lt 51539607558 2026-02-13T05:55:33.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:33.420 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411333 2026-02-13T05:55:33.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:33.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:55:33.422 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411333 2026-02-13T05:55:33.422 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:33.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411333 2026-02-13T05:55:33.423 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 77309411333 2026-02-13T05:55:33.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411333' 2026-02-13T05:55:33.424 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:55:33.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411333 -lt 77309411333 2026-02-13T05:55:33.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:33.647 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116997 2026-02-13T05:55:33.647 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:33.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:55:33.648 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116997 2026-02-13T05:55:33.648 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:33.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116997 2026-02-13T05:55:33.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116997' 2026-02-13T05:55:33.650 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 115964116997 2026-02-13T05:55:33.650 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:55:33.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116997 -lt 115964116997 2026-02-13T05:55:33.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:33.871 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-154618822661 2026-02-13T05:55:33.871 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:33.872 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:55:33.872 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-154618822661 2026-02-13T05:55:33.873 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:33.874 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822661 2026-02-13T05:55:33.874 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 154618822661' 2026-02-13T05:55:33.874 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 154618822661 2026-02-13T05:55:33.874 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:55:34.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822661 -lt 154618822661 2026-02-13T05:55:34.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:34.099 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-188978561028 2026-02-13T05:55:34.099 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:34.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:55:34.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-188978561028 2026-02-13T05:55:34.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:34.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=188978561028 2026-02-13T05:55:34.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 188978561028' 2026-02-13T05:55:34.102 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 188978561028 2026-02-13T05:55:34.102 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:55:34.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 188978561028 -lt 188978561028 2026-02-13T05:55:34.322 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:34.322 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-219043332099 2026-02-13T05:55:34.322 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:34.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:55:34.323 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-219043332099 2026-02-13T05:55:34.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:34.325 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=219043332099 2026-02-13T05:55:34.325 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 219043332099' 2026-02-13T05:55:34.325 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 219043332099 2026-02-13T05:55:34.325 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:55:34.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 219043332100 -lt 219043332099 2026-02-13T05:55:34.549 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:55:34.549 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:55:34.549 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:55:34.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:55:34.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:55:34.870 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:55:34.870 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:55:34.870 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:55:34.870 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:55:34.870 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:55:34.870 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:55:35.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:55:35.091 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:55:35.091 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:55:35.091 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:55:35.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:55:35.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:55:35.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:55:35.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:511: TEST_ec_recovery_multiple_objects_eio: rados_put td/test-erasure-eio pool-jerasure test1 2026-02-13T05:55:35.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:55:35.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:55:35.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test1 2026-02-13T05:55:35.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:35.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:55:35.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:35.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:55:35.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:35.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:55:35.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:35.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:55:35.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test1 td/test-erasure-eio/ORIGINAL 2026-02-13T05:55:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:512: TEST_ec_recovery_multiple_objects_eio: rados_put td/test-erasure-eio pool-jerasure test2 2026-02-13T05:55:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:55:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:55:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test2 2026-02-13T05:55:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:55:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:55:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:35.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:55:35.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:35.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:55:35.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test2 td/test-erasure-eio/ORIGINAL 2026-02-13T05:55:35.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:513: TEST_ec_recovery_multiple_objects_eio: rados_put td/test-erasure-eio pool-jerasure test3 2026-02-13T05:55:35.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:55:35.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:55:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test3 2026-02-13T05:55:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:55:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:55:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:55:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:55:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:55:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test3 td/test-erasure-eio/ORIGINAL 2026-02-13T05:55:35.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:516: TEST_ec_recovery_multiple_objects_eio: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 0 2026-02-13T05:55:35.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T05:55:35.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T05:55:35.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T05:55:35.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T05:55:35.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T05:55:35.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T05:55:35.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=myobject 2026-02-13T05:55:35.466 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T05:55:35.466 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T05:55:35.466 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T05:55:35.466 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-13T05:55:35.466 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T05:55:35.466 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure myobject 2026-02-13T05:55:35.466 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:55:35.466 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-13T05:55:35.466 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-13T05:55:35.466 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:55:35.694 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:55:35.694 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:55:35.694 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:55:35.695 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:55:35.695 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:55:35.695 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2026-02-13T05:55:35.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '5' '1' '0' '6') 2026-02-13T05:55:35.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T05:55:35.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-13T05:55:35.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T05:55:35.695 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-13T05:55:35.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T05:55:35.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-13T05:55:35.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T05:55:35.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-13T05:55:35.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T05:55:35.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T05:55:35.698 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T05:55:35.698 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-13T05:55:35.698 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T05:55:35.698 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T05:55:35.698 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:55:35.698 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:35.698 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:35.698 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T05:55:35.698 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-13T05:55:35.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T05:55:35.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T05:55:35.750 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T05:55:35.750 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-13T05:55:35.750 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T05:55:35.750 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T05:55:35.750 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:55:35.750 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:35.750 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:35.750 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T05:55:35.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T05:55:35.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.3.asok injectdataerr pool-jerasure myobject 0 2026-02-13T05:55:35.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:517: TEST_ec_recovery_multiple_objects_eio: ceph osd out 0 2026-02-13T05:55:36.074 INFO:tasks.workunit.client.0.trial024.stderr:osd.0 is already out. 2026-02-13T05:55:36.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:520: TEST_ec_recovery_multiple_objects_eio: wait_for_clean 2026-02-13T05:55:36.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:55:36.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:55:36.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:55:36.084 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:55:36.085 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:55:36.085 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:55:36.085 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:55:36.085 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:55:36.085 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:55:36.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:55:36.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:55:36.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:55:36.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:55:36.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:55:36.170 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:55:36.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:55:36.394 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:55:36.394 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:55:36.394 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:55:36.394 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:55:36.394 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:55:36.394 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:55:36.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:55:36.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:36.395 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:55:36.458 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803785 2026-02-13T05:55:36.458 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803785 2026-02-13T05:55:36.458 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785' 2026-02-13T05:55:36.458 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:36.458 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:55:36.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607561 2026-02-13T05:55:36.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607561 2026-02-13T05:55:36.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561' 2026-02-13T05:55:36.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:36.524 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:55:36.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411336 2026-02-13T05:55:36.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411336 2026-02-13T05:55:36.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-77309411336' 2026-02-13T05:55:36.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:36.588 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:55:36.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964117000 2026-02-13T05:55:36.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964117000 2026-02-13T05:55:36.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-77309411336 3-115964117000' 2026-02-13T05:55:36.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:36.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:55:36.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822664 2026-02-13T05:55:36.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822664 2026-02-13T05:55:36.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-77309411336 3-115964117000 4-154618822664' 2026-02-13T05:55:36.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:36.717 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:55:36.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561031 2026-02-13T05:55:36.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561031 2026-02-13T05:55:36.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-77309411336 3-115964117000 4-154618822664 5-188978561031' 2026-02-13T05:55:36.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:55:36.780 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:55:36.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=219043332102 2026-02-13T05:55:36.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 219043332102 2026-02-13T05:55:36.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-77309411336 3-115964117000 4-154618822664 5-188978561031 6-219043332102' 2026-02-13T05:55:36.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:36.845 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803785 2026-02-13T05:55:36.846 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:36.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:55:36.847 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803785 2026-02-13T05:55:36.847 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:36.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803785 2026-02-13T05:55:36.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-13T05:55:36.848 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803785 2026-02-13T05:55:36.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:55:37.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 0 -lt 25769803785 2026-02-13T05:55:37.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:55:38.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:55:38.069 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:55:38.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 0 -lt 25769803785 2026-02-13T05:55:38.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:55:39.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T05:55:39.294 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:55:39.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803785 -lt 25769803785 2026-02-13T05:55:39.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:39.519 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607561 2026-02-13T05:55:39.519 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:39.520 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:55:39.520 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607561 2026-02-13T05:55:39.521 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:39.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607561 2026-02-13T05:55:39.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607561' 2026-02-13T05:55:39.522 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607561 2026-02-13T05:55:39.522 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:55:39.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607561 -lt 51539607561 2026-02-13T05:55:39.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:39.746 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411336 2026-02-13T05:55:39.746 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:39.747 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:55:39.747 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411336 2026-02-13T05:55:39.747 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:39.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411336 2026-02-13T05:55:39.748 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411336' 2026-02-13T05:55:39.749 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 77309411336 2026-02-13T05:55:39.749 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:55:39.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411336 -lt 77309411336 2026-02-13T05:55:39.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:39.975 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964117000 2026-02-13T05:55:39.976 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:39.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:55:39.977 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964117000 2026-02-13T05:55:39.977 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:39.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964117000 2026-02-13T05:55:39.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964117000' 2026-02-13T05:55:39.978 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 115964117000 2026-02-13T05:55:39.978 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:55:40.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964117000 -lt 115964117000 2026-02-13T05:55:40.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:40.203 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-154618822664 2026-02-13T05:55:40.203 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:40.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:55:40.204 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-154618822664 2026-02-13T05:55:40.204 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:40.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822664 2026-02-13T05:55:40.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 154618822664' 2026-02-13T05:55:40.206 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 154618822664 2026-02-13T05:55:40.206 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:55:40.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822665 -lt 154618822664 2026-02-13T05:55:40.429 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:40.430 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-188978561031 2026-02-13T05:55:40.430 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:40.430 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:55:40.431 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-188978561031 2026-02-13T05:55:40.431 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:40.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=188978561031 2026-02-13T05:55:40.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 188978561031' 2026-02-13T05:55:40.433 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 188978561031 2026-02-13T05:55:40.433 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:55:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 188978561031 -lt 188978561031 2026-02-13T05:55:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:55:40.656 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-219043332102 2026-02-13T05:55:40.657 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:55:40.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:55:40.658 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-219043332102 2026-02-13T05:55:40.658 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:55:40.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=219043332102 2026-02-13T05:55:40.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 219043332102' 2026-02-13T05:55:40.659 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 219043332102 2026-02-13T05:55:40.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:55:40.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 219043332103 -lt 219043332102 2026-02-13T05:55:40.883 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:55:40.883 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:55:40.883 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:55:41.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:55:41.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:55:41.192 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:55:41.192 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:55:41.192 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:55:41.193 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:55:41.193 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:55:41.193 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:55:41.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-13T05:55:41.416 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:55:41.417 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:55:41.417 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:55:41.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 5 2026-02-13T05:55:41.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 4 '!=' -1 2026-02-13T05:55:41.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T05:55:41.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=4 2026-02-13T05:55:41.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T05:55:41.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T05:55:41.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T05:55:41.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:55:41.827 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:55:41.827 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:55:41.828 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:55:41.828 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:55:41.828 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:55:41.828 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:55:42.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-13T05:55:42.047 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:55:42.047 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:55:42.047 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:55:42.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 5 2026-02-13T05:55:42.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 4 '!=' 4 2026-02-13T05:55:42.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T05:55:42.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T05:55:42.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T05:55:42.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T05:55:42.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T05:55:42.364 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T05:55:42.364 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T05:55:42.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T05:55:42.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T05:55:42.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 13 )) 2026-02-13T05:55:42.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T05:55:42.683 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T05:55:42.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T05:55:42.884 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:55:42.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:55:42.885 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:55:42.885 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:55:42.885 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:55:42.885 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:55:42.885 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:55:43.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:55:43.109 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:55:43.109 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:55:43.109 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:55:43.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:55:43.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:55:43.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:55:43.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:522: TEST_ec_recovery_multiple_objects_eio: rados_get td/test-erasure-eio pool-jerasure test1 2026-02-13T05:55:43.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:55:43.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:55:43.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test1 2026-02-13T05:55:43.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:55:43.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:55:43.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test1 td/test-erasure-eio/COPY 2026-02-13T05:55:43.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:55:43.441 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:55:43.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:523: TEST_ec_recovery_multiple_objects_eio: rados_get td/test-erasure-eio pool-jerasure test2 2026-02-13T05:55:43.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:55:43.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:55:43.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test2 2026-02-13T05:55:43.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:55:43.443 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:55:43.443 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test2 td/test-erasure-eio/COPY 2026-02-13T05:55:43.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:55:43.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:55:43.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:524: TEST_ec_recovery_multiple_objects_eio: rados_get td/test-erasure-eio pool-jerasure test3 2026-02-13T05:55:43.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:55:43.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:55:43.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test3 2026-02-13T05:55:43.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:55:43.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:55:43.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test3 td/test-erasure-eio/COPY 2026-02-13T05:55:43.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:55:43.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:55:43.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:526: TEST_ec_recovery_multiple_objects_eio: delete_erasure_coded_pool pool-jerasure 2026-02-13T05:55:43.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:55:43.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T05:55:43.751 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T05:55:43.759 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T05:55:44.031 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T05:55:44.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T05:55:44.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:55:44.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:55:44.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:55:44.040 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:55:44.040 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:55:44.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:55:44.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:55:44.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:55:44.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:55:44.151 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:55:44.152 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:55:44.153 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:55:44.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:55:44.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:55:44.155 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:55:44.155 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:55:44.155 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:55:44.156 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:55:44.156 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:55:44.157 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:55:44.157 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:55:44.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:55:44.172 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:55:44.172 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:44.172 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:44.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:55:44.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:55:44.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:55:44.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T05:55:44.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T05:55:44.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T05:55:44.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T05:55:44.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:55:44.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:55:44.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:55:44.175 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:55:44.175 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:55:44.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:55:44.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:55:44.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:55:44.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:55:44.176 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:55:44.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:55:44.177 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:55:44.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:55:44.178 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:55:44.178 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:55:44.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:55:44.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:55:44.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:55:44.179 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:55:44.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:55:44.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:55:44.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:55:44.182 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:55:44.182 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:44.182 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:44.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:55:44.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:55:44.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:55:44.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T05:55:44.185 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:55:44.185 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:44.185 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:44.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T05:55:44.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:55:44.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:55:44.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:55:44.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T05:55:44.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T05:55:44.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T05:55:44.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:55:44.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:55:44.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:55:44.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T05:55:44.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T05:55:44.208 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:55:44.209 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:44.209 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:44.209 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:44.209 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:44.209 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:44.209 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:44.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:55:44.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:55:44.238 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:55:44.238 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:55:44.238 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:55:44.238 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:55:44.238 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:55:44.239 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:55:44.239 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:55:44.239 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:55:44.239 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:55:44.240 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:44.240 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:44.240 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:55:44.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:55:44.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T05:55:44.284 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:55:44.284 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:55:44.284 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:55:44.284 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:55:44.284 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:55:44.284 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:55:44.284 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:55:44.284 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:55:44.285 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:55:44.286 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:44.286 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:44.286 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:55:44.286 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:55:44.286 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T05:55:44.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T05:55:44.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T05:55:44.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:55:44.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:55:44.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:55:44.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T05:55:44.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:55:44.431 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:55:44.432 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:44.432 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:44.432 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:44.432 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:44.432 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:44.432 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:44.432 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:55:44.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:55:44.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T05:55:44.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:55:44.546 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:55:44.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:55:45.555 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T05:55:45.555 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:55:45.555 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:55:45.555 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:55:45.555 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:45.555 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:45.555 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:55:45.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T05:55:45.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T05:55:45.597 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:55:45.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T05:55:45.603 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:55:44.229+0000 7f69e1ab8d80 0 load: jerasure load: lrc 2026-02-13T05:55:45.604 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_recovery_unfound td/test-erasure-eio 2026-02-13T05:55:45.604 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:629: TEST_ec_recovery_unfound: local dir=td/test-erasure-eio 2026-02-13T05:55:45.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:630: TEST_ec_recovery_unfound: local objname=myobject 2026-02-13T05:55:45.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:631: TEST_ec_recovery_unfound: local lastobj=100 2026-02-13T05:55:45.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:633: TEST_ec_recovery_unfound: local testobj=obj75 2026-02-13T05:55:45.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:635: TEST_ec_recovery_unfound: ORIG_ARGS='--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:55:45.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:636: TEST_ec_recovery_unfound: CEPH_ARGS+=' --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-13T05:55:45.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: CEPH_ARGS+=' --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-13T05:55:45.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:638: TEST_ec_recovery_unfound: setup_osds 5 2026-02-13T05:55:45.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=5 2026-02-13T05:55:45.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T05:55:45.605 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 5 - 1 2026-02-13T05:55:45.609 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 4 2026-02-13T05:55:45.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:55:45.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T05:55:45.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:55:45.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:55:45.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:55:45.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:55:45.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T05:55:45.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-13T05:55:45.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:55:45.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:55:45.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:55:45.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T05:55:45.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T05:55:45.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:55:45.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:55:45.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:55:45.611 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:55:45.611 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:45.611 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:45.611 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:45.611 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:45.611 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:45.611 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:45.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:45.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:55:45.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:55:45.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:55:45.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:55:45.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:55:45.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:55:45.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:55:45.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:55:45.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:55:45.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:55:45.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:55:45.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T05:55:45.612 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:55:45.613 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=832ae61f-434b-4ba2-bb12-9b7af4e55717 2026-02-13T05:55:45.613 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 832ae61f-434b-4ba2-bb12-9b7af4e55717' 2026-02-13T05:55:45.613 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 832ae61f-434b-4ba2-bb12-9b7af4e55717 2026-02-13T05:55:45.613 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:55:45.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDhvI5pMkMaJRAAor8p0gOfLWVyZi56glRcEg== 2026-02-13T05:55:45.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDhvI5pMkMaJRAAor8p0gOfLWVyZi56glRcEg=="}' 2026-02-13T05:55:45.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 832ae61f-434b-4ba2-bb12-9b7af4e55717 -i td/test-erasure-eio/0/new.json 2026-02-13T05:55:45.730 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:45.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T05:55:45.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDhvI5pMkMaJRAAor8p0gOfLWVyZi56glRcEg== --osd-uuid 832ae61f-434b-4ba2-bb12-9b7af4e55717 2026-02-13T05:55:45.761 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:45.760+0000 7f351ac10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:45.762 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:45.761+0000 7f351ac10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:45.763 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:45.762+0000 7f351ac10900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:45.763 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:45.763+0000 7f351ac10900 -1 bdev(0x5602a35dac00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:55:45.764 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:45.763+0000 7f351ac10900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T05:55:46.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T05:55:46.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:55:46.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:55:46.244 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:55:46.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:55:46.353 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:55:46.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:55:46.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:55:46.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:55:46.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:55:46.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:55:46.375 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:46.374+0000 7f639e4d9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:46.376 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:46.376+0000 7f639e4d9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:46.377 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:46.376+0000 7f639e4d9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:46.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:55:46.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:55:46.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:55:46.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:55:46.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:55:46.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:46.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:55:46.462 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:46.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:46.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:55:46.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:55:46.585 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:46.584+0000 7f639e4d9900 -1 Falling back to public interface 2026-02-13T05:55:46.815 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:46.814+0000 7f639e4d9900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:55:47.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:55:47.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:47.564 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:47.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:55:47.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:47.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:55:47.791 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3954232988,v1:127.0.0.1:6803/3954232988] [v2:127.0.0.1:6804/3954232988,v1:127.0.0.1:6805/3954232988] exists,up 832ae61f-434b-4ba2-bb12-9b7af4e55717 2026-02-13T05:55:47.795 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:55:47.795 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:55:47.795 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:55:47.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:55:47.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T05:55:47.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:55:47.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:55:47.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:55:47.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:55:47.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:55:47.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-13T05:55:47.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:55:47.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:47.797 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:47.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:47.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:55:47.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:55:47.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:55:47.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:55:47.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:55:47.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:55:47.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:55:47.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:55:47.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:55:47.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:55:47.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:55:47.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:55:47.799 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:55:47.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a25548fd-92c5-4d40-94be-b4061dc3dea7 2026-02-13T05:55:47.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 a25548fd-92c5-4d40-94be-b4061dc3dea7' 2026-02-13T05:55:47.799 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 a25548fd-92c5-4d40-94be-b4061dc3dea7 2026-02-13T05:55:47.799 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:55:47.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDjvI5pKvFJMBAAugvdt3reuThrAsWVlPx++Q== 2026-02-13T05:55:47.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDjvI5pKvFJMBAAugvdt3reuThrAsWVlPx++Q=="}' 2026-02-13T05:55:47.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a25548fd-92c5-4d40-94be-b4061dc3dea7 -i td/test-erasure-eio/1/new.json 2026-02-13T05:55:48.043 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:48.050 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T05:55:48.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDjvI5pKvFJMBAAugvdt3reuThrAsWVlPx++Q== --osd-uuid a25548fd-92c5-4d40-94be-b4061dc3dea7 2026-02-13T05:55:48.073 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:48.072+0000 7f2cee140900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:48.074 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:48.074+0000 7f2cee140900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:48.076 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:48.075+0000 7f2cee140900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:48.076 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:48.075+0000 7f2cee140900 -1 bdev(0x55bebcaf2c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:55:48.076 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:48.075+0000 7f2cee140900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T05:55:48.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T05:55:48.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:55:48.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:55:48.407 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:55:48.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:55:48.725 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:55:48.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:55:48.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:55:48.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:55:48.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:55:48.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:55:48.746 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:48.746+0000 7f1e54742900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:48.748 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:48.747+0000 7f1e54742900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:48.749 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:48.748+0000 7f1e54742900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:48.877 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:48.876+0000 7f1e54742900 -1 Falling back to public interface 2026-02-13T05:55:48.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:55:48.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:55:48.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:55:48.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:55:48.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:55:48.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:48.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:55:48.957 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:48.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:48.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:55:49.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:55:49.193 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:49.192+0000 7f1e54742900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:55:50.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:55:50.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:50.186 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:50.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:55:50.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:50.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:55:50.415 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/817573532,v1:127.0.0.1:6811/817573532] [v2:127.0.0.1:6812/817573532,v1:127.0.0.1:6813/817573532] exists,up a25548fd-92c5-4d40-94be-b4061dc3dea7 2026-02-13T05:55:50.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:55:50.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:55:50.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:55:50.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:55:50.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T05:55:50.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:55:50.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:55:50.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:55:50.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:55:50.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:55:50.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-13T05:55:50.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:55:50.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:55:50.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:55:50.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:55:50.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:55:50.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:55:50.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:55:50.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:55:50.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:55:50.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:55:50.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:55:50.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:55:50.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:55:50.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:55:50.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:55:50.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:55:50.422 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:55:50.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=79001973-ed15-44ad-a028-ddec2127f170 2026-02-13T05:55:50.423 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 79001973-ed15-44ad-a028-ddec2127f170 2026-02-13T05:55:50.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 79001973-ed15-44ad-a028-ddec2127f170' 2026-02-13T05:55:50.423 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:55:50.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDmvI5pVUXDGRAAl34e+DfGCbDJF3WrScln5w== 2026-02-13T05:55:50.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDmvI5pVUXDGRAAl34e+DfGCbDJF3WrScln5w=="}' 2026-02-13T05:55:50.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 79001973-ed15-44ad-a028-ddec2127f170 -i td/test-erasure-eio/2/new.json 2026-02-13T05:55:50.663 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:55:50.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T05:55:50.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDmvI5pVUXDGRAAl34e+DfGCbDJF3WrScln5w== --osd-uuid 79001973-ed15-44ad-a028-ddec2127f170 2026-02-13T05:55:50.694 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:50.692+0000 7fb090e22900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:50.695 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:50.693+0000 7fb090e22900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:50.696 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:50.694+0000 7fb090e22900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:50.696 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:50.694+0000 7fb090e22900 -1 bdev(0x5600988a2c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:55:50.696 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:50.694+0000 7fb090e22900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T05:55:51.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T05:55:51.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:55:51.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:55:51.025 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:55:51.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:55:51.343 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:55:51.343 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:55:51.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:55:51.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:55:51.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:55:51.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:55:51.371 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:51.370+0000 7f485260c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:51.373 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:51.371+0000 7f485260c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:51.374 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:51.372+0000 7f485260c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:51.523 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:51.521+0000 7f485260c900 -1 Falling back to public interface 2026-02-13T05:55:51.571 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:55:51.571 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:55:51.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:55:51.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:55:51.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:55:51.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:51.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:55:51.572 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:51.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:51.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:55:51.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:55:51.815 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:51.813+0000 7f485260c900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:55:52.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:55:52.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:52.801 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:52.801 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:55:52.801 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:52.801 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:55:53.027 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 17 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2093961441,v1:127.0.0.1:6819/2093961441] [v2:127.0.0.1:6820/2093961441,v1:127.0.0.1:6821/2093961441] exists,up 79001973-ed15-44ad-a028-ddec2127f170 2026-02-13T05:55:53.031 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:55:53.031 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:55:53.031 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:55:53.031 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:55:53.031 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T05:55:53.031 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:55:53.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:55:53.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T05:55:53.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:55:53.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:55:53.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-13T05:55:53.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:55:53.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:55:53.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:55:53.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:55:53.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:55:53.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:55:53.033 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:55:53.033 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:55:53.033 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:55:53.033 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:53.033 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:53.033 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:53.033 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:53.033 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:53.033 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:53.033 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:53.033 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:55:53.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2c5239dc-20db-4580-9dc1-ab76bc5f8de1 2026-02-13T05:55:53.035 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 2c5239dc-20db-4580-9dc1-ab76bc5f8de1 2026-02-13T05:55:53.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 2c5239dc-20db-4580-9dc1-ab76bc5f8de1' 2026-02-13T05:55:53.035 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:55:53.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDpvI5pOSiuAhAAnWP8KQS5wjMLdSu2Fz4egw== 2026-02-13T05:55:53.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDpvI5pOSiuAhAAnWP8KQS5wjMLdSu2Fz4egw=="}' 2026-02-13T05:55:53.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2c5239dc-20db-4580-9dc1-ab76bc5f8de1 -i td/test-erasure-eio/3/new.json 2026-02-13T05:55:53.276 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T05:55:53.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T05:55:53.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDpvI5pOSiuAhAAnWP8KQS5wjMLdSu2Fz4egw== --osd-uuid 2c5239dc-20db-4580-9dc1-ab76bc5f8de1 2026-02-13T05:55:53.307 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:53.305+0000 7f1a790d9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:53.308 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:53.306+0000 7f1a790d9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:53.309 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:53.307+0000 7f1a790d9900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:53.309 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:53.308+0000 7f1a790d9900 -1 bdev(0x5595f2d36c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T05:55:53.310 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:53.308+0000 7f1a790d9900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T05:55:53.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T05:55:53.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:55:53.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T05:55:53.635 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T05:55:53.636 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:55:53.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T05:55:53.953 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:55:53.954 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:55:53.954 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:55:53.954 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:55:53.954 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:55:53.973 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:53.971+0000 7f4c3d20f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:53.975 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:53.973+0000 7f4c3d20f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:53.975 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:53.974+0000 7f4c3d20f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:54.099 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:54.097+0000 7f4c3d20f900 -1 Falling back to public interface 2026-02-13T05:55:54.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T05:55:54.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:55:54.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:55:54.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:55:54.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:55:54.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:54.185 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:54.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:55:54.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:54.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:55:54.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:55:54.418 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:54.416+0000 7f4c3d20f900 -1 osd.3 0 log_to_monitors true 2026-02-13T05:55:55.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:55:55.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:55.413 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:55.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:55:55.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:55.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:55:55.640 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 24 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2164060892,v1:127.0.0.1:6827/2164060892] [v2:127.0.0.1:6828/2164060892,v1:127.0.0.1:6829/2164060892] exists,up 2c5239dc-20db-4580-9dc1-ab76bc5f8de1 2026-02-13T05:55:55.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:55:55.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:55:55.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:55:55.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:55:55.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-13T05:55:55.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:55:55.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:55:55.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-13T05:55:55.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:55:55.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-13T05:55:55.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-13T05:55:55.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:55:55.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:55:55.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:55:55.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-13T05:55:55.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-13T05:55:55.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:55:55.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:55:55.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:55:55.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:55:55.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:55:55.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:55:55.645 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:55:55.646 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:55.646 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:55.646 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:55.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:55:55.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:55:55.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:55:55.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:55:55.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:55:55.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:55:55.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:55:55.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:55:55.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:55:55.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:55:55.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:55:55.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:55:55.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-13T05:55:55.647 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:55:55.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2da7e4f3-157d-4aef-a172-1d6da0d979cf 2026-02-13T05:55:55.647 INFO:tasks.workunit.client.0.trial024.stdout:add osd4 2da7e4f3-157d-4aef-a172-1d6da0d979cf 2026-02-13T05:55:55.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 2da7e4f3-157d-4aef-a172-1d6da0d979cf' 2026-02-13T05:55:55.648 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:55:55.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDrvI5pTv4vJxAArfDPOMErQh+xNWSNJmSNaw== 2026-02-13T05:55:55.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDrvI5pTv4vJxAArfDPOMErQh+xNWSNJmSNaw=="}' 2026-02-13T05:55:55.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2da7e4f3-157d-4aef-a172-1d6da0d979cf -i td/test-erasure-eio/4/new.json 2026-02-13T05:55:55.892 INFO:tasks.workunit.client.0.trial024.stdout:4 2026-02-13T05:55:55.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-13T05:55:55.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDrvI5pTv4vJxAArfDPOMErQh+xNWSNJmSNaw== --osd-uuid 2da7e4f3-157d-4aef-a172-1d6da0d979cf 2026-02-13T05:55:55.922 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:55.920+0000 7fc0b7821900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:55.923 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:55.922+0000 7fc0b7821900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:55.924 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:55.923+0000 7fc0b7821900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:55.925 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:55.923+0000 7fc0b7821900 -1 bdev(0x55efce42ec00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-13T05:55:55.925 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:55.923+0000 7fc0b7821900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-13T05:55:56.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-13T05:55:56.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:55:56.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-13T05:55:56.262 INFO:tasks.workunit.client.0.trial024.stdout:adding osd4 key to auth repository 2026-02-13T05:55:56.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:55:56.607 INFO:tasks.workunit.client.0.trial024.stdout:start osd.4 2026-02-13T05:55:56.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-13T05:55:56.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:55:56.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:55:56.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:55:56.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:55:56.628 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:56.627+0000 7f53daf8c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:56.630 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:56.628+0000 7f53daf8c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:56.631 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:56.629+0000 7f53daf8c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:55:56.754 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:56.753+0000 7f53daf8c900 -1 Falling back to public interface 2026-02-13T05:55:56.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-13T05:55:56.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:55:56.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-13T05:55:56.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:55:56.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:55:56.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:56.836 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:55:56.837 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:55:56.837 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:56.837 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:55:57.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:55:57.091 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:55:57.089+0000 7f53daf8c900 -1 osd.4 0 log_to_monitors true 2026-02-13T05:55:58.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:55:58.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:55:58.065 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:55:58.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:55:58.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:55:58.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:55:58.290 INFO:tasks.workunit.client.0.trial024.stdout:osd.4 up in weight 1 up_from 33 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3320214291,v1:127.0.0.1:6835/3320214291] [v2:127.0.0.1:6836/3320214291,v1:127.0.0.1:6837/3320214291] exists,up 2da7e4f3-157d-4aef-a172-1d6da0d979cf 2026-02-13T05:55:58.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:55:58.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:55:58.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:55:58.292 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T05:55:58.292 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:55:58.293 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:55:58.293 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:55:58.293 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:55:58.293 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:55:58.293 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:55:58.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T05:55:58.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T05:55:58.337 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:55:58.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T05:55:58.344 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:55:46.587+0000 7f639e4d9900 0 load: jerasure load: lrc 2026-02-13T05:55:58.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: CEPH_ARGS='--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:55:58.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:641: TEST_ec_recovery_unfound: local poolname=pool-jerasure 2026-02-13T05:55:58.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:642: TEST_ec_recovery_unfound: create_erasure_coded_pool pool-jerasure 3 2 2026-02-13T05:55:58.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:55:58.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T05:55:58.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-13T05:55:58.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T05:55:58.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-13T05:55:58.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T05:55:58.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-13T05:55:58.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T05:55:58.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T05:55:58.999 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T05:55:59.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:56:00.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T05:56:00.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:56:00.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:56:00.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:56:00.010 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:56:00.010 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:56:00.010 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:56:00.010 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:56:00.011 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:56:00.011 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:56:00.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:56:00.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:56:00.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:56:00.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:56:00.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:56:00.096 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:56:00.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:56:00.318 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:56:00.318 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:56:00.318 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:56:00.318 INFO:tasks.workunit.client.0.trial024.stderr:4' 2026-02-13T05:56:00.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:56:00.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:00.319 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:56:00.381 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803781 2026-02-13T05:56:00.382 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803781 2026-02-13T05:56:00.382 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781' 2026-02-13T05:56:00.382 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:00.382 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:56:00.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607557 2026-02-13T05:56:00.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607557 2026-02-13T05:56:00.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607557' 2026-02-13T05:56:00.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:00.446 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:56:00.511 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444036 2026-02-13T05:56:00.511 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444036 2026-02-13T05:56:00.511 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607557 2-73014444036' 2026-02-13T05:56:00.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:00.512 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:56:00.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215108 2026-02-13T05:56:00.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215108 2026-02-13T05:56:00.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607557 2-73014444036 3-103079215108' 2026-02-13T05:56:00.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:00.577 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:56:00.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920771 2026-02-13T05:56:00.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920771 2026-02-13T05:56:00.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803781 1-51539607557 2-73014444036 3-103079215108 4-141733920771' 2026-02-13T05:56:00.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:56:00.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803781 2026-02-13T05:56:00.643 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:56:00.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:56:00.644 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803781 2026-02-13T05:56:00.644 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:56:00.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803781 2026-02-13T05:56:00.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803781' 2026-02-13T05:56:00.645 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803781 2026-02-13T05:56:00.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:56:00.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803781 2026-02-13T05:56:00.868 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:56:00.869 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607557 2026-02-13T05:56:00.869 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:56:00.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:56:00.870 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607557 2026-02-13T05:56:00.871 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:56:00.872 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607557 2026-02-13T05:56:00.872 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607557' 2026-02-13T05:56:00.872 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607557 2026-02-13T05:56:00.872 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:56:01.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607557 -lt 51539607557 2026-02-13T05:56:01.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:56:01.102 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444036 2026-02-13T05:56:01.102 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:56:01.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:56:01.104 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444036 2026-02-13T05:56:01.104 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:56:01.105 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444036 2026-02-13T05:56:01.105 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444036' 2026-02-13T05:56:01.105 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 73014444036 2026-02-13T05:56:01.105 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:56:01.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444034 -lt 73014444036 2026-02-13T05:56:01.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:56:02.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:56:02.331 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:56:02.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444036 -lt 73014444036 2026-02-13T05:56:02.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:56:02.557 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-103079215108 2026-02-13T05:56:02.557 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:56:02.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:56:02.558 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-103079215108 2026-02-13T05:56:02.559 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:56:02.560 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=103079215108 2026-02-13T05:56:02.560 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 103079215108' 2026-02-13T05:56:02.560 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 103079215108 2026-02-13T05:56:02.560 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:56:02.782 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 103079215108 -lt 103079215108 2026-02-13T05:56:02.783 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:56:02.783 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-141733920771 2026-02-13T05:56:02.783 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:56:02.784 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:56:02.785 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-141733920771 2026-02-13T05:56:02.785 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:56:02.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920771 2026-02-13T05:56:02.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 141733920771' 2026-02-13T05:56:02.786 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 141733920771 2026-02-13T05:56:02.787 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:56:03.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920771 -lt 141733920771 2026-02-13T05:56:03.014 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:56:03.014 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:56:03.014 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:56:03.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:56:03.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:56:03.329 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:56:03.330 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:56:03.330 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:56:03.330 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:56:03.330 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:56:03.330 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:56:03.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:56:03.557 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:56:03.557 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:56:03.557 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:56:03.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:56:03.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:56:03.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:56:03.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:644: TEST_ec_recovery_unfound: ceph pg dump pgs 2026-02-13T05:56:04.079 INFO:tasks.workunit.client.0.trial024.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T05:56:04.079 INFO:tasks.workunit.client.0.trial024.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:55:59.721772+0000 0'0 39:13 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-13T05:55:58.938022+0000 0'0 2026-02-13T05:55:58.938022+0000 0 0 periodic scrub scheduled @ 2026-02-14T10:36:38.350092+0000 0 0 2026-02-13T05:56:04.079 INFO:tasks.workunit.client.0.trial024.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:55:58.681718+0000 0'0 40:21 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-13T05:55:44.528802+0000 0'0 2026-02-13T05:55:44.528802+0000 0 0 periodic scrub scheduled @ 2026-02-14T07:53:37.468172+0000 0 0 2026-02-13T05:56:04.079 INFO:tasks.workunit.client.0.trial024.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:55:58.329340+0000 0'0 39:91 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-13T05:55:44.528802+0000 0'0 2026-02-13T05:55:44.528802+0000 0 0 periodic scrub scheduled @ 2026-02-14T08:11:32.607040+0000 0 0 2026-02-13T05:56:04.079 INFO:tasks.workunit.client.0.trial024.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:55:58.379316+0000 0'0 40:21 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-13T05:55:44.528802+0000 0'0 2026-02-13T05:55:44.528802+0000 0 0 periodic scrub scheduled @ 2026-02-14T09:57:58.210810+0000 0 0 2026-02-13T05:56:04.079 INFO:tasks.workunit.client.0.trial024.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:55:52.554943+0000 0'0 39:61 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T05:55:44.528802+0000 0'0 2026-02-13T05:55:44.528802+0000 0 0 periodic scrub scheduled @ 2026-02-14T14:02:43.891310+0000 0 0 2026-02-13T05:56:04.079 INFO:tasks.workunit.client.0.trial024.stdout: 2026-02-13T05:56:04.080 INFO:tasks.workunit.client.0.trial024.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T05:56:04.080 INFO:tasks.workunit.client.0.trial024.stderr:dumped pgs 2026-02-13T05:56:04.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:646: TEST_ec_recovery_unfound: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-13T05:56:04.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:56:04.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:56:04.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-13T05:56:04.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:56:04.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:56:04.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:56:04.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:56:04.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:56:04.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:56:04.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:56:04.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:56:04.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:04.108 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:648: TEST_ec_recovery_unfound: get_osds pool-jerasure myobject 2026-02-13T05:56:04.108 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:56:04.108 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-13T05:56:04.108 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-13T05:56:04.109 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:56:04.336 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:56:04.337 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:56:04.337 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:56:04.337 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:56:04.337 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:56:04.337 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 4 0 2 2026-02-13T05:56:04.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:648: TEST_ec_recovery_unfound: initial_osds=('3' '1' '4' '0' '2') 2026-02-13T05:56:04.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:648: TEST_ec_recovery_unfound: local -a initial_osds 2026-02-13T05:56:04.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:649: TEST_ec_recovery_unfound: local last_osd=2 2026-02-13T05:56:04.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:650: TEST_ec_recovery_unfound: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-13T05:56:04.337 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:56:04.337 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:56:04.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:56:04.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:56:04.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:56:04.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:56:04.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:651: TEST_ec_recovery_unfound: ceph osd down 2 2026-02-13T05:56:04.868 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 is already down. 2026-02-13T05:56:04.876 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:652: TEST_ec_recovery_unfound: ceph osd out 2 2026-02-13T05:56:05.121 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 is already out. 2026-02-13T05:56:05.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:654: TEST_ec_recovery_unfound: ceph pg dump pgs 2026-02-13T05:56:05.356 INFO:tasks.workunit.client.0.trial024.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T05:56:05.356 INFO:tasks.workunit.client.0.trial024.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:55:59.721772+0000 0'0 39:13 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-13T05:55:58.938022+0000 0'0 2026-02-13T05:55:58.938022+0000 0 0 periodic scrub scheduled @ 2026-02-14T10:36:38.350092+0000 0 0 2026-02-13T05:56:05.356 INFO:tasks.workunit.client.0.trial024.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:55:58.681718+0000 0'0 40:21 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-13T05:55:44.528802+0000 0'0 2026-02-13T05:55:44.528802+0000 0 0 periodic scrub scheduled @ 2026-02-14T07:53:37.468172+0000 0 0 2026-02-13T05:56:05.356 INFO:tasks.workunit.client.0.trial024.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:55:58.329340+0000 0'0 40:93 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-13T05:55:44.528802+0000 0'0 2026-02-13T05:55:44.528802+0000 0 0 periodic scrub scheduled @ 2026-02-14T08:11:32.607040+0000 0 0 2026-02-13T05:56:05.357 INFO:tasks.workunit.client.0.trial024.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:55:58.379316+0000 0'0 40:21 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-13T05:55:44.528802+0000 0'0 2026-02-13T05:55:44.528802+0000 0 0 periodic scrub scheduled @ 2026-02-14T09:57:58.210810+0000 0 0 2026-02-13T05:56:05.357 INFO:tasks.workunit.client.0.trial024.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:55:52.554943+0000 0'0 39:61 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T05:55:44.528802+0000 0'0 2026-02-13T05:55:44.528802+0000 0 0 periodic scrub scheduled @ 2026-02-14T14:02:43.891310+0000 0 0 2026-02-13T05:56:05.357 INFO:tasks.workunit.client.0.trial024.stdout: 2026-02-13T05:56:05.357 INFO:tasks.workunit.client.0.trial024.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T05:56:05.357 INFO:tasks.workunit.client.0.trial024.stderr:dumped pgs 2026-02-13T05:56:05.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:656: TEST_ec_recovery_unfound: dd if=/dev/urandom of=td/test-erasure-eio/ORIGINAL bs=1024 count=4 2026-02-13T05:56:05.364 INFO:tasks.workunit.client.0.trial024.stderr:4+0 records in 2026-02-13T05:56:05.364 INFO:tasks.workunit.client.0.trial024.stderr:4+0 records out 2026-02-13T05:56:05.365 INFO:tasks.workunit.client.0.trial024.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 6.8177e-05 s, 60.1 MB/s 2026-02-13T05:56:05.365 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: seq 1 100 2026-02-13T05:56:05.366 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.366 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj1 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj2 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj3 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj4 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.443 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.443 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj5 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj6 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj7 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.499 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.499 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj8 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj9 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj10 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj11 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj12 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj13 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj14 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.627 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj15 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj16 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj17 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj18 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj19 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj20 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj21 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj22 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj23 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj24 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj25 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj26 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj27 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj28 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj29 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj30 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.920 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj31 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj32 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj33 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj34 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:05.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:05.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj35 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj36 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.029 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj37 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj38 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj39 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj40 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj41 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.118 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.118 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj42 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj43 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj44 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj45 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj46 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj47 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj48 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj49 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj50 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj51 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj52 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj53 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj54 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj55 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj56 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.394 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj57 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj58 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj59 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj60 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj61 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj62 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj63 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj64 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj65 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.566 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.566 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj66 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj67 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.604 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj68 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.622 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.622 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj69 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj70 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj71 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj72 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj73 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj74 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj75 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj76 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj77 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj78 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj79 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj80 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj81 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.867 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj82 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.885 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.885 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj83 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj84 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj85 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj86 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj87 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj88 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:06.996 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:06.996 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj89 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:07.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:07.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj90 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:07.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:07.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj91 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:07.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:07.053 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj92 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:07.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:07.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj93 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:07.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:07.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj94 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:07.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:07.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj95 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:07.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:07.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj96 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:07.147 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:07.147 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj97 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:07.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:07.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj98 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:07.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:07.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj99 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:07.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:657: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:07.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:659: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj100 td/test-erasure-eio/ORIGINAL 2026-02-13T05:56:07.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:662: TEST_ec_recovery_unfound: inject_eio ec data pool-jerasure obj75 td/test-erasure-eio 0 2026-02-13T05:56:07.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T05:56:07.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T05:56:07.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T05:56:07.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T05:56:07.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T05:56:07.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T05:56:07.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj75 2026-02-13T05:56:07.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T05:56:07.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T05:56:07.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T05:56:07.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-13T05:56:07.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T05:56:07.223 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj75 2026-02-13T05:56:07.223 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:56:07.223 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj75 2026-02-13T05:56:07.224 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj75 2026-02-13T05:56:07.224 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:56:07.451 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:56:07.451 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:56:07.451 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:56:07.451 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:56:07.452 INFO:tasks.workunit.client.0.trial024.stderr:2147483647' 2026-02-13T05:56:07.452 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 4 0 2147483647 2026-02-13T05:56:07.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '4' '0' '2147483647') 2026-02-13T05:56:07.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T05:56:07.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-13T05:56:07.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T05:56:07.452 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-13T05:56:07.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T05:56:07.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-13T05:56:07.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T05:56:07.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-13T05:56:07.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T05:56:07.454 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T05:56:07.454 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T05:56:07.455 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-13T05:56:07.455 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T05:56:07.455 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T05:56:07.455 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:56:07.455 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:07.455 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:07.455 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T05:56:07.455 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-13T05:56:07.505 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T05:56:07.506 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T05:56:07.506 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T05:56:07.507 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-13T05:56:07.507 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T05:56:07.507 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T05:56:07.508 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:56:07.508 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:07.508 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:07.508 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T05:56:07.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T05:56:07.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.3.asok injectdataerr pool-jerasure obj75 0 2026-02-13T05:56:07.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:663: TEST_ec_recovery_unfound: inject_eio ec data pool-jerasure obj75 td/test-erasure-eio 1 2026-02-13T05:56:07.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T05:56:07.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T05:56:07.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T05:56:07.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T05:56:07.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T05:56:07.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T05:56:07.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj75 2026-02-13T05:56:07.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T05:56:07.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T05:56:07.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T05:56:07.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=1 2026-02-13T05:56:07.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T05:56:07.559 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj75 2026-02-13T05:56:07.559 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:56:07.559 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj75 2026-02-13T05:56:07.559 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj75 2026-02-13T05:56:07.559 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:56:07.784 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:56:07.784 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:56:07.784 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:56:07.784 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:56:07.784 INFO:tasks.workunit.client.0.trial024.stderr:2147483647' 2026-02-13T05:56:07.784 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 4 0 2147483647 2026-02-13T05:56:07.784 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '4' '0' '2147483647') 2026-02-13T05:56:07.784 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T05:56:07.784 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-13T05:56:07.785 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T05:56:07.785 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/1/type 2026-02-13T05:56:07.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T05:56:07.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-13T05:56:07.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T05:56:07.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-13T05:56:07.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T05:56:07.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T05:56:07.786 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T05:56:07.787 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-13T05:56:07.787 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T05:56:07.787 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T05:56:07.787 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:56:07.788 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:07.788 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:07.788 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.1.asok 2026-02-13T05:56:07.788 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-13T05:56:07.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T05:56:07.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T05:56:07.837 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T05:56:07.837 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-13T05:56:07.838 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T05:56:07.838 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T05:56:07.838 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:56:07.838 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:07.838 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:07.838 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.1.asok 2026-02-13T05:56:07.838 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T05:56:07.839 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.1.asok injectdataerr pool-jerasure obj75 1 2026-02-13T05:56:07.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:665: TEST_ec_recovery_unfound: activate_osd td/test-erasure-eio 2 2026-02-13T05:56:07.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:56:07.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:56:07.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T05:56:07.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:56:07.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:56:07.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:56:07.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:56:07.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:07.888 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:07.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:07.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:56:07.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:56:07.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:56:07.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:56:07.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:56:07.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:56:07.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:56:07.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:56:07.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:56:07.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:56:07.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T05:56:07.890 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:56:07.891 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:56:07.891 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-13T05:56:07.891 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T05:56:07.891 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:56:07.891 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:56:07.891 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:56:07.903 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:07.901+0000 7f1b887cf900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:07.904 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:07.903+0000 7f1b887cf900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:07.905 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:07.904+0000 7f1b887cf900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:08.049 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:08.048+0000 7f1b887cf900 -1 Falling back to public interface 2026-02-13T05:56:08.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T05:56:08.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:56:08.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:56:08.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:56:08.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:56:08.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:08.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:56:08.117 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:56:08.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:08.118 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:56:08.340 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:56:08.451 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:08.449+0000 7f1b887cf900 -1 osd.2 40 log_to_monitors true 2026-02-13T05:56:09.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:56:09.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:09.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:56:09.341 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:56:09.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:09.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:56:09.572 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up out weight 0 up_from 46 up_thru 17 down_at 41 last_clean_interval [17,40) [v2:127.0.0.1:6818/844472001,v1:127.0.0.1:6819/844472001] [v2:127.0.0.1:6820/844472001,v1:127.0.0.1:6821/844472001] exists,up 79001973-ed15-44ad-a028-ddec2127f170 2026-02-13T05:56:09.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:56:09.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:56:09.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:56:09.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:666: TEST_ec_recovery_unfound: ceph osd in 2 2026-02-13T05:56:09.808 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 is already in. 2026-02-13T05:56:09.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:668: TEST_ec_recovery_unfound: sleep 15 2026-02-13T05:56:24.818 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:670: TEST_ec_recovery_unfound: seq 1 100 2026-02-13T05:56:24.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:670: TEST_ec_recovery_unfound: for tmp in $(seq 1 100) 2026-02-13T05:56:24.819 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:671: TEST_ec_recovery_unfound: get_state 2.0 2026-02-13T05:56:24.819 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:60: get_state: local pgid=2.0 2026-02-13T05:56:24.820 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:61: get_state: local sname=state 2026-02-13T05:56:24.820 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:62: get_state: ceph --format json pg dump pgs 2026-02-13T05:56:24.820 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:63: get_state: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .state' 2026-02-13T05:56:25.042 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:671: TEST_ec_recovery_unfound: state=active+recovery_unfound+degraded 2026-02-13T05:56:25.042 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:672: TEST_ec_recovery_unfound: echo active+recovery_unfound+degraded 2026-02-13T05:56:25.042 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:672: TEST_ec_recovery_unfound: grep recovery_unfound 2026-02-13T05:56:25.043 INFO:tasks.workunit.client.0.trial024.stdout:active+recovery_unfound+degraded 2026-02-13T05:56:25.043 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:673: TEST_ec_recovery_unfound: '[' 0 = 0 ']' 2026-02-13T05:56:25.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:674: TEST_ec_recovery_unfound: break 2026-02-13T05:56:25.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: ceph pg dump pgs 2026-02-13T05:56:25.256 INFO:tasks.workunit.client.0.trial024.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T05:56:25.257 INFO:tasks.workunit.client.0.trial024.stdout:2.0 101 1 3 0 1 413696 0 0 101 0 101 active+recovery_unfound+degraded 2026-02-13T05:56:09.850513+0000 44'101 51:360 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-13T05:55:58.938022+0000 0'0 2026-02-13T05:55:58.938022+0000 0 0 no scrub is scheduled 0 0 2026-02-13T05:56:25.257 INFO:tasks.workunit.client.0.trial024.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:56:09.848575+0000 0'0 51:60 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-13T05:55:44.528802+0000 0'0 2026-02-13T05:55:44.528802+0000 0 0 periodic scrub scheduled @ 2026-02-14T11:31:38.547115+0000 0 0 2026-02-13T05:56:25.257 INFO:tasks.workunit.client.0.trial024.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:55:58.329340+0000 0'0 51:112 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-13T05:55:44.528802+0000 0'0 2026-02-13T05:55:44.528802+0000 0 0 periodic scrub scheduled @ 2026-02-14T08:11:32.607040+0000 0 0 2026-02-13T05:56:25.257 INFO:tasks.workunit.client.0.trial024.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:55:58.379316+0000 0'0 51:42 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-13T05:55:44.528802+0000 0'0 2026-02-13T05:55:44.528802+0000 0 0 periodic scrub scheduled @ 2026-02-14T09:57:58.210810+0000 0 0 2026-02-13T05:56:25.257 INFO:tasks.workunit.client.0.trial024.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T05:56:09.848972+0000 0'0 51:101 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T05:55:44.528802+0000 0'0 2026-02-13T05:55:44.528802+0000 0 0 periodic scrub scheduled @ 2026-02-14T08:51:41.143001+0000 0 0 2026-02-13T05:56:25.257 INFO:tasks.workunit.client.0.trial024.stdout: 2026-02-13T05:56:25.257 INFO:tasks.workunit.client.0.trial024.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T05:56:25.257 INFO:tasks.workunit.client.0.trial024.stderr:dumped pgs 2026-02-13T05:56:25.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:681: TEST_ec_recovery_unfound: ceph pg 2.0 list_unfound 2026-02-13T05:56:25.327 INFO:tasks.workunit.client.0.trial024.stdout:{ 2026-02-13T05:56:25.327 INFO:tasks.workunit.client.0.trial024.stdout: "num_missing": 1, 2026-02-13T05:56:25.327 INFO:tasks.workunit.client.0.trial024.stdout: "num_unfound": 1, 2026-02-13T05:56:25.327 INFO:tasks.workunit.client.0.trial024.stdout: "objects": [ 2026-02-13T05:56:25.328 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.328 INFO:tasks.workunit.client.0.trial024.stdout: "oid": { 2026-02-13T05:56:25.328 INFO:tasks.workunit.client.0.trial024.stdout: "oid": "obj75", 2026-02-13T05:56:25.328 INFO:tasks.workunit.client.0.trial024.stdout: "key": "", 2026-02-13T05:56:25.328 INFO:tasks.workunit.client.0.trial024.stdout: "snapid": -2, 2026-02-13T05:56:25.328 INFO:tasks.workunit.client.0.trial024.stdout: "hash": 3565005477, 2026-02-13T05:56:25.328 INFO:tasks.workunit.client.0.trial024.stdout: "max": 0, 2026-02-13T05:56:25.328 INFO:tasks.workunit.client.0.trial024.stdout: "pool": 2, 2026-02-13T05:56:25.328 INFO:tasks.workunit.client.0.trial024.stdout: "namespace": "" 2026-02-13T05:56:25.328 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.328 INFO:tasks.workunit.client.0.trial024.stdout: "need": "44'76", 2026-02-13T05:56:25.329 INFO:tasks.workunit.client.0.trial024.stdout: "have": "0'0", 2026-02-13T05:56:25.329 INFO:tasks.workunit.client.0.trial024.stdout: "flags": "none", 2026-02-13T05:56:25.329 INFO:tasks.workunit.client.0.trial024.stdout: "clean_regions": "clean_offsets: [], clean_omap: false, new_object: true", 2026-02-13T05:56:25.329 INFO:tasks.workunit.client.0.trial024.stdout: "locations": [ 2026-02-13T05:56:25.329 INFO:tasks.workunit.client.0.trial024.stdout: "0(3)", 2026-02-13T05:56:25.329 INFO:tasks.workunit.client.0.trial024.stdout: "4(2)" 2026-02-13T05:56:25.329 INFO:tasks.workunit.client.0.trial024.stdout: ] 2026-02-13T05:56:25.329 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.329 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.329 INFO:tasks.workunit.client.0.trial024.stdout: "state": "NotRecovering", 2026-02-13T05:56:25.329 INFO:tasks.workunit.client.0.trial024.stdout: "available_might_have_unfound": true, 2026-02-13T05:56:25.329 INFO:tasks.workunit.client.0.trial024.stdout: "might_have_unfound": [], 2026-02-13T05:56:25.330 INFO:tasks.workunit.client.0.trial024.stdout: "more": false 2026-02-13T05:56:25.330 INFO:tasks.workunit.client.0.trial024.stdout:} 2026-02-13T05:56:25.333 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: ceph pg 2.0 query 2026-02-13T05:56:25.395 INFO:tasks.workunit.client.0.trial024.stdout:{ 2026-02-13T05:56:25.395 INFO:tasks.workunit.client.0.trial024.stdout: "snap_trimq": "[]", 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "snap_trimq_len": 0, 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "state": "active+recovery_unfound+degraded", 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "epoch": 51, 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "up": [ 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: 2 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "acting": [ 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: 2 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "acting_recovery_backfill": [ 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "0(3)", 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "1(1)", 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "2(4)", 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "3(0)", 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "4(2)" 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "info": { 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "pgid": "2.0s0", 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "shard": "0", 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "last_update": "44'101", 2026-02-13T05:56:25.396 INFO:tasks.workunit.client.0.trial024.stdout: "last_complete": "44'75", 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "log_tail": "0'0", 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_user_version": 101, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_backfill": "MAX", 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete": [], 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete_epoch": "50", 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [], 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "history": { 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_created": 38, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_pool_created": 38, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 51, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_started": 50, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 39, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_clean": 38, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_split": 0, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_marked_full": 0, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "same_up_since": 50, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "same_interval_since": 50, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "same_primary_since": 38, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "prior_readable_until_ub": 0 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "stats": { 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "version": "44'101", 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "reported_seq": 361, 2026-02-13T05:56:25.397 INFO:tasks.workunit.client.0.trial024.stdout: "reported_epoch": 51, 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "state": "active+recovery_unfound+degraded", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_fresh": "2026-02-13T05:56:09.850513+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_change": "2026-02-13T05:56:09.850513+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_active": "2026-02-13T05:56:09.850513+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_peered": "2026-02-13T05:56:09.850513+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean": "2026-02-13T05:56:04.105931+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_active": "2026-02-13T05:56:09.848844+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_peered": "2026-02-13T05:56:09.848844+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_unstale": "2026-02-13T05:56:09.850513+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_undegraded": "2026-02-13T05:56:09.847637+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_fullsized": "2026-02-13T05:56:09.850513+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "mapping_epoch": 50, 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "log_start": "0'0", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_start": "0'0", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "created": 38, 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 39, 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "parent": "0.0", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "parent_split_bits": 0, 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "objects_scrubbed": 0, 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "log_size": 101, 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "log_dups_size": 0, 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_size": 101, 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "stats_invalid": false, 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "dirty_stats_invalid": false, 2026-02-13T05:56:25.398 INFO:tasks.workunit.client.0.trial024.stdout: "omap_stats_invalid": false, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_stats_invalid": false, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_bytes_stats_invalid": false, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "pin_stats_invalid": false, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "manifest_stats_invalid": false, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrimq_len": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_duration": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_schedule": "no scrub is scheduled", 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_duration": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "objects_trimmed": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrim_duration": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "stat_sum": { 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes": 413696, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects": 101, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_clones": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_copies": 505, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing_on_primary": 1, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing": 1, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_degraded": 3, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_misplaced": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_unfound": 1, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_dirty": 101, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_whiteouts": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_read": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_read_kb": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_write": 101, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_write_kb": 404, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_scrub_errors": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_deep_scrub_errors": 0, 2026-02-13T05:56:25.399 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_recovered": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_recovered": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_keys_recovered": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_omap": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_kb": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_kb": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_promote": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_high": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_low": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_some": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_full": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_pinned": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_legacy_snapsets": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_large_omap_objects": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_manifest": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_bytes": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_keys": 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_repaired": 0 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "up": [ 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: 2 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.400 INFO:tasks.workunit.client.0.trial024.stdout: "acting": [ 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: 2 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "avail_no_missing": [ 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "0(3)", 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "4(2)" 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "object_location_counts": [ 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "shards": "0(3),1(1),2(4),3(0),4(2)", 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "objects": 100 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "shards": "0(3),4(2)", 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "objects": 1 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "blocked_by": [], 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "up_primary": 3, 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "acting_primary": 3, 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [] 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "empty": 0, 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "dne": 0, 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "incomplete": 0, 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 51, 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "hit_set_history": { 2026-02-13T05:56:25.401 INFO:tasks.workunit.client.0.trial024.stdout: "current_last_update": "0'0", 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "history": [] 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "peer_info": [ 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "peer": "0(3)", 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "pgid": "2.0s3", 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "shard": "3", 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "last_update": "44'101", 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "last_complete": "44'101", 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "log_tail": "0'0", 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "last_user_version": 101, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "last_backfill": "MAX", 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete": [], 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [], 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "history": { 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_created": 38, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_pool_created": 38, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 51, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_started": 50, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 39, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_clean": 38, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_split": 0, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_marked_full": 0, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "same_up_since": 50, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "same_interval_since": 50, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "same_primary_since": 38, 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:56:25.402 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "prior_readable_until_ub": 0 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "stats": { 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "version": "44'101", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "reported_seq": 349, 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "reported_epoch": 50, 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "state": "active+undersized+degraded", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_fresh": "2026-02-13T05:56:07.220116+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_change": "2026-02-13T05:56:04.522567+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_active": "2026-02-13T05:56:07.220116+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_peered": "2026-02-13T05:56:07.220116+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean": "2026-02-13T05:56:04.105931+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_active": "2026-02-13T05:56:04.522567+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_peered": "2026-02-13T05:56:04.522567+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_unstale": "2026-02-13T05:56:07.220116+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_undegraded": "2026-02-13T05:56:04.521288+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_fullsized": "2026-02-13T05:56:04.521208+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "mapping_epoch": 50, 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "log_start": "0'0", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_start": "0'0", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "created": 38, 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 39, 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "parent": "0.0", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "parent_split_bits": 0, 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.403 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "objects_scrubbed": 0, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "log_size": 101, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "log_dups_size": 0, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_size": 101, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "stats_invalid": false, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "dirty_stats_invalid": false, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "omap_stats_invalid": false, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_stats_invalid": false, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_bytes_stats_invalid": false, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "pin_stats_invalid": false, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "manifest_stats_invalid": false, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrimq_len": 0, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_duration": 0, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-14T07:51:39.076865+0000", 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_duration": 0, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "objects_trimmed": 0, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrim_duration": 0, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "stat_sum": { 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes": 413696, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects": 101, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_clones": 0, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_copies": 505, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing": 0, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_degraded": 101, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_misplaced": 0, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_unfound": 0, 2026-02-13T05:56:25.404 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_dirty": 101, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_whiteouts": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_read": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_read_kb": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_write": 101, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_write_kb": 404, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_scrub_errors": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_deep_scrub_errors": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_recovered": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_recovered": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_keys_recovered": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_omap": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_kb": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_kb": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_promote": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_high": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_low": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_some": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_full": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_pinned": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_legacy_snapsets": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_large_omap_objects": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_manifest": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_bytes": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_keys": 0, 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_repaired": 0 2026-02-13T05:56:25.405 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "up": [ 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: 2 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "acting": [ 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: 2 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "avail_no_missing": [ 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "3(0)", 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "0(3)", 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "1(1)", 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "4(2)" 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "object_location_counts": [ 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "objects": 101 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "blocked_by": [], 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "up_primary": 3, 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "acting_primary": 3, 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [] 2026-02-13T05:56:25.406 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "empty": 0, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "dne": 0, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "incomplete": 0, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 51, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "hit_set_history": { 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "current_last_update": "0'0", 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "history": [] 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "peer": "1(1)", 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "pgid": "2.0s1", 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "shard": "1", 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "last_update": "44'101", 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "last_complete": "44'101", 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "log_tail": "0'0", 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "last_user_version": 101, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "last_backfill": "MAX", 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete": [], 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [], 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "history": { 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_created": 38, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_pool_created": 38, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 51, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_started": 50, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 39, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_clean": 38, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_split": 0, 2026-02-13T05:56:25.407 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_marked_full": 0, 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "same_up_since": 50, 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "same_interval_since": 50, 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "same_primary_since": 38, 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "prior_readable_until_ub": 0 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "stats": { 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "version": "44'101", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "reported_seq": 131, 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "reported_epoch": 44, 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "state": "active+undersized+degraded", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_fresh": "2026-02-13T05:56:07.220116+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_change": "2026-02-13T05:56:04.522567+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_active": "2026-02-13T05:56:07.220116+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_peered": "2026-02-13T05:56:07.220116+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean": "2026-02-13T05:56:04.105931+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_active": "2026-02-13T05:56:04.522567+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_peered": "2026-02-13T05:56:04.522567+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_unstale": "2026-02-13T05:56:07.220116+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_undegraded": "2026-02-13T05:56:04.521288+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_fullsized": "2026-02-13T05:56:04.521208+0000", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "mapping_epoch": 50, 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "log_start": "0'0", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_start": "0'0", 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "created": 38, 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 39, 2026-02-13T05:56:25.408 INFO:tasks.workunit.client.0.trial024.stdout: "parent": "0.0", 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "parent_split_bits": 0, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "objects_scrubbed": 0, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "log_size": 101, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "log_dups_size": 0, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_size": 101, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "stats_invalid": false, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "dirty_stats_invalid": false, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "omap_stats_invalid": false, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_stats_invalid": false, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_bytes_stats_invalid": false, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "pin_stats_invalid": false, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "manifest_stats_invalid": false, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrimq_len": 0, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_duration": 0, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-14T07:51:39.076865+0000", 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_duration": 0, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "objects_trimmed": 0, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrim_duration": 0, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "stat_sum": { 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes": 413696, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects": 101, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_clones": 0, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_copies": 505, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing": 1, 2026-02-13T05:56:25.409 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_degraded": 101, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_misplaced": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_unfound": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_dirty": 101, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_whiteouts": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_read": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_read_kb": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_write": 101, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_write_kb": 404, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_scrub_errors": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_deep_scrub_errors": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_recovered": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_recovered": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_keys_recovered": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_omap": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_kb": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_kb": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_promote": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_high": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_low": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_some": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_full": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_pinned": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_legacy_snapsets": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_large_omap_objects": 0, 2026-02-13T05:56:25.410 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_manifest": 0, 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_bytes": 0, 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_keys": 0, 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_repaired": 0 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "up": [ 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: 2 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "acting": [ 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: 2 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "avail_no_missing": [ 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "3(0)", 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "0(3)", 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "1(1)", 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "4(2)" 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "object_location_counts": [ 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "objects": 101 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.411 INFO:tasks.workunit.client.0.trial024.stdout: "blocked_by": [], 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "up_primary": 3, 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "acting_primary": 3, 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [] 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "empty": 0, 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "dne": 0, 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "incomplete": 0, 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 51, 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "hit_set_history": { 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "current_last_update": "0'0", 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "history": [] 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "peer": "2(4)", 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "pgid": "2.0s4", 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "shard": "4", 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "last_update": "44'101", 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "last_complete": "44'75", 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "log_tail": "0'0", 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "last_user_version": 101, 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "last_backfill": "MAX", 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete": [], 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [], 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "history": { 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_created": 38, 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_pool_created": 38, 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 51, 2026-02-13T05:56:25.412 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_started": 50, 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 39, 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_clean": 38, 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_split": 0, 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_marked_full": 0, 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "same_up_since": 50, 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "same_interval_since": 50, 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "same_primary_since": 38, 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "prior_readable_until_ub": 0 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "stats": { 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "version": "44'101", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "reported_seq": 137, 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "reported_epoch": 48, 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "state": "remapped+peering", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_fresh": "2026-02-13T05:56:09.340012+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_change": "2026-02-13T05:56:09.238428+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_active": "2026-02-13T05:56:09.238428+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_peered": "2026-02-13T05:56:09.211658+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean": "2026-02-13T05:56:04.105931+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_active": "2026-02-13T05:56:04.522567+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_peered": "2026-02-13T05:56:04.522567+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_unstale": "2026-02-13T05:56:09.340012+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_undegraded": "2026-02-13T05:56:09.340012+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "last_fullsized": "2026-02-13T05:56:09.340012+0000", 2026-02-13T05:56:25.413 INFO:tasks.workunit.client.0.trial024.stdout: "mapping_epoch": 50, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "log_start": "0'0", 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_start": "0'0", 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "created": 38, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 39, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "parent": "0.0", 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "parent_split_bits": 0, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "objects_scrubbed": 0, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "log_size": 101, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "log_dups_size": 0, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_size": 101, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "stats_invalid": false, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "dirty_stats_invalid": false, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "omap_stats_invalid": false, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_stats_invalid": false, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_bytes_stats_invalid": false, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "pin_stats_invalid": false, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "manifest_stats_invalid": false, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrimq_len": 0, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_duration": 0, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_schedule": "no scrub is scheduled", 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_duration": 0, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "objects_trimmed": 0, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrim_duration": 0, 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "stat_sum": { 2026-02-13T05:56:25.414 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes": 413696, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects": 101, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_clones": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_copies": 505, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing": 1, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_degraded": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_misplaced": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_unfound": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_dirty": 101, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_whiteouts": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_read": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_read_kb": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_write": 101, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_write_kb": 404, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_scrub_errors": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_deep_scrub_errors": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_recovered": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_recovered": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_keys_recovered": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_omap": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_kb": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_kb": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_promote": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_high": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_low": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_some": 0, 2026-02-13T05:56:25.415 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_full": 0, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_pinned": 0, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "num_legacy_snapsets": 0, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "num_large_omap_objects": 0, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_manifest": 0, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_bytes": 0, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_keys": 0, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_repaired": 0 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "up": [ 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: 2 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "acting": [ 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: 2 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "avail_no_missing": [], 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "object_location_counts": [], 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "blocked_by": [], 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "up_primary": 3, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "acting_primary": 3, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [] 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.416 INFO:tasks.workunit.client.0.trial024.stdout: "empty": 0, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "dne": 0, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "incomplete": 0, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 51, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "hit_set_history": { 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "current_last_update": "0'0", 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "history": [] 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "peer": "4(2)", 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "pgid": "2.0s2", 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "shard": "2", 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "last_update": "44'101", 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "last_complete": "44'101", 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "log_tail": "0'0", 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "last_user_version": 101, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "last_backfill": "MAX", 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete": [], 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [], 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "history": { 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_created": 38, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "epoch_pool_created": 38, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 51, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_started": 50, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 39, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "last_interval_clean": 38, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_split": 0, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_marked_full": 0, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "same_up_since": 50, 2026-02-13T05:56:25.417 INFO:tasks.workunit.client.0.trial024.stdout: "same_interval_since": 50, 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "same_primary_since": 38, 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "prior_readable_until_ub": 0 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "stats": { 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "version": "44'101", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "reported_seq": 131, 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "reported_epoch": 44, 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "state": "active+undersized+degraded", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_fresh": "2026-02-13T05:56:07.220116+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_change": "2026-02-13T05:56:04.522567+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_active": "2026-02-13T05:56:07.220116+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_peered": "2026-02-13T05:56:07.220116+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean": "2026-02-13T05:56:04.105931+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_active": "2026-02-13T05:56:04.522567+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_became_peered": "2026-02-13T05:56:04.522567+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_unstale": "2026-02-13T05:56:07.220116+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_undegraded": "2026-02-13T05:56:04.521288+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_fullsized": "2026-02-13T05:56:04.521208+0000", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "mapping_epoch": 50, 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "log_start": "0'0", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_start": "0'0", 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "created": 38, 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_clean": 39, 2026-02-13T05:56:25.418 INFO:tasks.workunit.client.0.trial024.stdout: "parent": "0.0", 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "parent_split_bits": 0, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub": "0'0", 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub": "0'0", 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "last_deep_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "last_clean_scrub_stamp": "2026-02-13T05:55:58.938022+0000", 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "objects_scrubbed": 0, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "log_size": 101, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "log_dups_size": 0, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "ondisk_log_size": 101, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "stats_invalid": false, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "dirty_stats_invalid": false, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "omap_stats_invalid": false, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_stats_invalid": false, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "hitset_bytes_stats_invalid": false, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "pin_stats_invalid": false, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "manifest_stats_invalid": false, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrimq_len": 0, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "last_scrub_duration": 0, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-14T07:51:39.076865+0000", 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_duration": 0, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "objects_trimmed": 0, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "snaptrim_duration": 0, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "stat_sum": { 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes": 413696, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects": 101, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_clones": 0, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "num_object_copies": 505, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_missing": 0, 2026-02-13T05:56:25.419 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_degraded": 101, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_misplaced": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_unfound": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_dirty": 101, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_whiteouts": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_read": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_read_kb": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_write": 101, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_write_kb": 404, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_scrub_errors": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_deep_scrub_errors": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_recovered": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_recovered": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_keys_recovered": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_omap": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_kb": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_kb": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_promote": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_high": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_flush_mode_low": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_some": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_evict_mode_full": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_pinned": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_legacy_snapsets": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_large_omap_objects": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_manifest": 0, 2026-02-13T05:56:25.420 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_bytes": 0, 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "num_omap_keys": 0, 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "num_objects_repaired": 0 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "up": [ 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: 2 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "acting": [ 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: 3, 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: 1, 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: 4, 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: 0, 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: 2 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "avail_no_missing": [ 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "3(0)", 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "0(3)", 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "1(1)", 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "4(2)" 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "object_location_counts": [ 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "objects": 101 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "blocked_by": [], 2026-02-13T05:56:25.421 INFO:tasks.workunit.client.0.trial024.stdout: "up_primary": 3, 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "acting_primary": 3, 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "purged_snaps": [] 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "empty": 0, 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "dne": 0, 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "incomplete": 0, 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "last_epoch_started": 51, 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "hit_set_history": { 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "current_last_update": "0'0", 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "history": [] 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "recovery_state": [ 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "name": "Started/Primary/Active", 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "enter_time": "2026-02-13T05:56:09.847492+0000", 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "might_have_unfound": [ 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "osd": "0(3)", 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "status": "already probed" 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "osd": "1(1)", 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "status": "already probed" 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "osd": "2(4)", 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: "status": "already probed" 2026-02-13T05:56:25.422 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "osd": "4(2)", 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "status": "already probed" 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "recovery_progress": { 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "backfill_targets": [], 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "waiting_on_backfill": [], 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "last_backfill_started": "MIN", 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "backfill_info": { 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "begin": "MIN", 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "end": "MIN", 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "objects": [] 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "peer_backfill_info": [], 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "backfills_in_flight": [], 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "recovering": [], 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "pg_backend": { 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "recovery_ops": [], 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "read_ops": [] 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: { 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "name": "Started", 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "enter_time": "2026-02-13T05:56:09.745911+0000" 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: } 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: ], 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "scrubber": { 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "active": false, 2026-02-13T05:56:25.423 INFO:tasks.workunit.client.0.trial024.stdout: "must_scrub": false, 2026-02-13T05:56:25.424 INFO:tasks.workunit.client.0.trial024.stdout: "must_deep_scrub": false, 2026-02-13T05:56:25.424 INFO:tasks.workunit.client.0.trial024.stdout: "must_repair": false, 2026-02-13T05:56:25.424 INFO:tasks.workunit.client.0.trial024.stdout: "scrub_reg_stamp": "2026-02-14T07:51:39.076865+0000", 2026-02-13T05:56:25.424 INFO:tasks.workunit.client.0.trial024.stdout: "schedule": "not registered for scrubbing" 2026-02-13T05:56:25.424 INFO:tasks.workunit.client.0.trial024.stdout: }, 2026-02-13T05:56:25.424 INFO:tasks.workunit.client.0.trial024.stdout: "agent_state": {} 2026-02-13T05:56:25.424 INFO:tasks.workunit.client.0.trial024.stdout:} 2026-02-13T05:56:25.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:684: TEST_ec_recovery_unfound: ceph pg 2.0 list_unfound 2026-02-13T05:56:25.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:684: TEST_ec_recovery_unfound: grep -q obj75 2026-02-13T05:56:25.467 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: ceph pg 2.0 list_unfound 2026-02-13T05:56:25.467 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: jq .available_might_have_unfound 2026-02-13T05:56:25.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: check=true 2026-02-13T05:56:25.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: test true == true 2026-02-13T05:56:25.535 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:689: TEST_ec_recovery_unfound: ceph pg 2.0 list_unfound 2026-02-13T05:56:25.535 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:689: TEST_ec_recovery_unfound: jq '.might_have_unfound | length' 2026-02-13T05:56:25.601 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:689: TEST_ec_recovery_unfound: check=0 2026-02-13T05:56:25.601 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:690: TEST_ec_recovery_unfound: test 0 == 0 2026-02-13T05:56:25.601 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:693: TEST_ec_recovery_unfound: timeout 5 rados -p pool-jerasure get obj75 td/test-erasure-eio/CHECK 2026-02-13T05:56:30.604 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:694: TEST_ec_recovery_unfound: test 124 = 124 2026-02-13T05:56:30.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:696: TEST_ec_recovery_unfound: ceph pg 2.0 mark_unfound_lost delete 2026-02-13T05:56:30.668 INFO:tasks.workunit.client.0.trial024.stderr:pg has no unfound objects 2026-02-13T05:56:30.675 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:698: TEST_ec_recovery_unfound: wait_for_clean 2026-02-13T05:56:30.675 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:56:30.676 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:56:30.676 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:56:30.676 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:56:30.676 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:56:30.677 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:56:30.677 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:56:30.677 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:56:30.677 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:56:30.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:56:30.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:56:30.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:56:30.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:56:30.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:56:30.762 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:56:30.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:56:30.991 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:56:30.991 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:56:30.991 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:56:30.991 INFO:tasks.workunit.client.0.trial024.stderr:4' 2026-02-13T05:56:30.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:56:30.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:30.992 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:56:31.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803789 2026-02-13T05:56:31.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803789 2026-02-13T05:56:31.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803789' 2026-02-13T05:56:31.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:31.055 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:56:31.121 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607565 2026-02-13T05:56:31.121 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607565 2026-02-13T05:56:31.121 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803789 1-51539607565' 2026-02-13T05:56:31.122 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:31.122 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:56:31.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=197568495623 2026-02-13T05:56:31.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 197568495623 2026-02-13T05:56:31.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803789 1-51539607565 2-197568495623' 2026-02-13T05:56:31.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:31.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:56:31.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215116 2026-02-13T05:56:31.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215116 2026-02-13T05:56:31.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803789 1-51539607565 2-197568495623 3-103079215116' 2026-02-13T05:56:31.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:31.251 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:56:31.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920779 2026-02-13T05:56:31.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920779 2026-02-13T05:56:31.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803789 1-51539607565 2-197568495623 3-103079215116 4-141733920779' 2026-02-13T05:56:31.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:56:31.317 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803789 2026-02-13T05:56:31.317 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:56:31.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:56:31.318 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803789 2026-02-13T05:56:31.318 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:56:31.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803789 2026-02-13T05:56:31.320 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803789 2026-02-13T05:56:31.320 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803789' 2026-02-13T05:56:31.320 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:56:31.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803787 -lt 25769803789 2026-02-13T05:56:31.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:56:32.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:56:32.548 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:56:32.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803789 -lt 25769803789 2026-02-13T05:56:32.770 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:56:32.771 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607565 2026-02-13T05:56:32.771 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:56:32.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:56:32.772 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607565 2026-02-13T05:56:32.773 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:56:32.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607565 2026-02-13T05:56:32.774 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607565 2026-02-13T05:56:32.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607565' 2026-02-13T05:56:32.774 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:56:33.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607565 -lt 51539607565 2026-02-13T05:56:33.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:56:33.004 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-197568495623 2026-02-13T05:56:33.005 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:56:33.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:56:33.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-197568495623 2026-02-13T05:56:33.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:56:33.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=197568495623 2026-02-13T05:56:33.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 197568495623' 2026-02-13T05:56:33.008 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 197568495623 2026-02-13T05:56:33.008 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:56:33.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 197568495623 -lt 197568495623 2026-02-13T05:56:33.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:56:33.232 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-103079215116 2026-02-13T05:56:33.232 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:56:33.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:56:33.233 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-103079215116 2026-02-13T05:56:33.234 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:56:33.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=103079215116 2026-02-13T05:56:33.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 103079215116' 2026-02-13T05:56:33.235 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 103079215116 2026-02-13T05:56:33.236 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:56:33.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 103079215116 -lt 103079215116 2026-02-13T05:56:33.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:56:33.459 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-141733920779 2026-02-13T05:56:33.459 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:56:33.460 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:56:33.461 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-141733920779 2026-02-13T05:56:33.461 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:56:33.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920779 2026-02-13T05:56:33.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 141733920779' 2026-02-13T05:56:33.463 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 141733920779 2026-02-13T05:56:33.463 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:56:33.684 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920779 -lt 141733920779 2026-02-13T05:56:33.685 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:56:33.685 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:56:33.685 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:56:33.997 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:56:33.997 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:56:33.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:56:33.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:56:33.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:56:33.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:56:33.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:56:33.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:56:34.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:56:34.219 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:56:34.219 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:56:34.219 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:56:34.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:56:34.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:56:34.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:56:34.529 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: seq 1 100 2026-02-13T05:56:34.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj1 = obj75 ']' 2026-02-13T05:56:34.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj1 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj2 = obj75 ']' 2026-02-13T05:56:34.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj2 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj3 = obj75 ']' 2026-02-13T05:56:34.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj3 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.586 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj4 = obj75 ']' 2026-02-13T05:56:34.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj4 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.604 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj5 = obj75 ']' 2026-02-13T05:56:34.605 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj5 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj6 = obj75 ']' 2026-02-13T05:56:34.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj6 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj7 = obj75 ']' 2026-02-13T05:56:34.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj7 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj8 = obj75 ']' 2026-02-13T05:56:34.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj8 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj9 = obj75 ']' 2026-02-13T05:56:34.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj9 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj10 = obj75 ']' 2026-02-13T05:56:34.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj10 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.714 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj11 = obj75 ']' 2026-02-13T05:56:34.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj11 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj12 = obj75 ']' 2026-02-13T05:56:34.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj12 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.749 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.750 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj13 = obj75 ']' 2026-02-13T05:56:34.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj13 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj14 = obj75 ']' 2026-02-13T05:56:34.768 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj14 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.786 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj15 = obj75 ']' 2026-02-13T05:56:34.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj15 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj16 = obj75 ']' 2026-02-13T05:56:34.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj16 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj17 = obj75 ']' 2026-02-13T05:56:34.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj17 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.841 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.841 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj18 = obj75 ']' 2026-02-13T05:56:34.841 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj18 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj19 = obj75 ']' 2026-02-13T05:56:34.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj19 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.875 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.876 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.876 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj20 = obj75 ']' 2026-02-13T05:56:34.876 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj20 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.893 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.894 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.894 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj21 = obj75 ']' 2026-02-13T05:56:34.894 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj21 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.912 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.912 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj22 = obj75 ']' 2026-02-13T05:56:34.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj22 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.930 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj23 = obj75 ']' 2026-02-13T05:56:34.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj23 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.949 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.951 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj24 = obj75 ']' 2026-02-13T05:56:34.951 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj24 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.969 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj25 = obj75 ']' 2026-02-13T05:56:34.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj25 td/test-erasure-eio/CHECK 2026-02-13T05:56:34.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:34.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:34.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj26 = obj75 ']' 2026-02-13T05:56:34.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj26 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj27 = obj75 ']' 2026-02-13T05:56:35.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj27 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj28 = obj75 ']' 2026-02-13T05:56:35.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj28 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.045 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj29 = obj75 ']' 2026-02-13T05:56:35.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj29 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj30 = obj75 ']' 2026-02-13T05:56:35.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj30 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj31 = obj75 ']' 2026-02-13T05:56:35.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj31 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj32 = obj75 ']' 2026-02-13T05:56:35.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj32 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.118 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj33 = obj75 ']' 2026-02-13T05:56:35.120 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj33 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj34 = obj75 ']' 2026-02-13T05:56:35.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj34 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.157 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj35 = obj75 ']' 2026-02-13T05:56:35.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj35 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj36 = obj75 ']' 2026-02-13T05:56:35.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj36 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.194 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj37 = obj75 ']' 2026-02-13T05:56:35.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj37 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.212 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj38 = obj75 ']' 2026-02-13T05:56:35.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj38 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj39 = obj75 ']' 2026-02-13T05:56:35.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj39 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj40 = obj75 ']' 2026-02-13T05:56:35.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj40 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.268 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj41 = obj75 ']' 2026-02-13T05:56:35.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj41 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj42 = obj75 ']' 2026-02-13T05:56:35.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj42 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj43 = obj75 ']' 2026-02-13T05:56:35.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj43 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj44 = obj75 ']' 2026-02-13T05:56:35.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj44 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.345 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj45 = obj75 ']' 2026-02-13T05:56:35.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj45 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj46 = obj75 ']' 2026-02-13T05:56:35.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj46 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.384 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.384 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj47 = obj75 ']' 2026-02-13T05:56:35.384 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj47 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj48 = obj75 ']' 2026-02-13T05:56:35.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj48 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj49 = obj75 ']' 2026-02-13T05:56:35.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj49 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj50 = obj75 ']' 2026-02-13T05:56:35.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj50 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.458 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj51 = obj75 ']' 2026-02-13T05:56:35.459 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj51 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.478 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.478 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj52 = obj75 ']' 2026-02-13T05:56:35.478 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj52 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.496 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.497 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.497 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj53 = obj75 ']' 2026-02-13T05:56:35.497 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj53 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj54 = obj75 ']' 2026-02-13T05:56:35.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj54 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj55 = obj75 ']' 2026-02-13T05:56:35.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj55 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj56 = obj75 ']' 2026-02-13T05:56:35.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj56 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj57 = obj75 ']' 2026-02-13T05:56:35.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj57 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj58 = obj75 ']' 2026-02-13T05:56:35.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj58 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj59 = obj75 ']' 2026-02-13T05:56:35.612 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj59 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.630 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj60 = obj75 ']' 2026-02-13T05:56:35.631 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj60 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj61 = obj75 ']' 2026-02-13T05:56:35.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj61 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.668 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj62 = obj75 ']' 2026-02-13T05:56:35.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj62 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj63 = obj75 ']' 2026-02-13T05:56:35.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj63 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj64 = obj75 ']' 2026-02-13T05:56:35.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj64 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.725 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.727 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj65 = obj75 ']' 2026-02-13T05:56:35.727 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj65 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj66 = obj75 ']' 2026-02-13T05:56:35.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj66 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj67 = obj75 ']' 2026-02-13T05:56:35.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj67 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj68 = obj75 ']' 2026-02-13T05:56:35.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj68 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj69 = obj75 ']' 2026-02-13T05:56:35.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj69 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj70 = obj75 ']' 2026-02-13T05:56:35.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj70 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.837 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.838 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.838 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj71 = obj75 ']' 2026-02-13T05:56:35.838 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj71 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj72 = obj75 ']' 2026-02-13T05:56:35.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj72 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.875 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.876 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.876 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj73 = obj75 ']' 2026-02-13T05:56:35.876 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj73 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.894 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.895 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.895 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj74 = obj75 ']' 2026-02-13T05:56:35.895 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj74 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.912 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj75 = obj75 ']' 2026-02-13T05:56:35.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:704: TEST_ec_recovery_unfound: rados -p pool-jerasure get obj75 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.930 INFO:tasks.workunit.client.0.trial024.stderr:error getting pool-jerasure/obj75: (2) No such file or directory 2026-02-13T05:56:35.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj76 = obj75 ']' 2026-02-13T05:56:35.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj76 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.949 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj77 = obj75 ']' 2026-02-13T05:56:35.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj77 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.968 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.969 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.969 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj78 = obj75 ']' 2026-02-13T05:56:35.969 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj78 td/test-erasure-eio/CHECK 2026-02-13T05:56:35.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:35.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:35.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj79 = obj75 ']' 2026-02-13T05:56:35.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj79 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj80 = obj75 ']' 2026-02-13T05:56:36.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj80 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.024 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj81 = obj75 ']' 2026-02-13T05:56:36.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj81 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.043 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj82 = obj75 ']' 2026-02-13T05:56:36.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj82 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj83 = obj75 ']' 2026-02-13T05:56:36.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj83 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj84 = obj75 ']' 2026-02-13T05:56:36.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj84 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj85 = obj75 ']' 2026-02-13T05:56:36.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj85 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.116 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj86 = obj75 ']' 2026-02-13T05:56:36.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj86 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj87 = obj75 ']' 2026-02-13T05:56:36.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj87 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.155 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.155 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj88 = obj75 ']' 2026-02-13T05:56:36.155 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj88 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.173 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj89 = obj75 ']' 2026-02-13T05:56:36.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj89 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.192 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj90 = obj75 ']' 2026-02-13T05:56:36.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj90 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.211 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.211 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj91 = obj75 ']' 2026-02-13T05:56:36.211 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj91 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.229 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj92 = obj75 ']' 2026-02-13T05:56:36.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj92 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.248 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj93 = obj75 ']' 2026-02-13T05:56:36.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj93 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj94 = obj75 ']' 2026-02-13T05:56:36.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj94 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj95 = obj75 ']' 2026-02-13T05:56:36.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj95 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj96 = obj75 ']' 2026-02-13T05:56:36.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj96 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj97 = obj75 ']' 2026-02-13T05:56:36.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj97 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.343 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj98 = obj75 ']' 2026-02-13T05:56:36.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj98 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.361 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj99 = obj75 ']' 2026-02-13T05:56:36.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj99 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:700: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-13T05:56:36.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:702: TEST_ec_recovery_unfound: '[' obj100 = obj75 ']' 2026-02-13T05:56:36.381 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:706: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj100 td/test-erasure-eio/CHECK 2026-02-13T05:56:36.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:707: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:711: TEST_ec_recovery_unfound: rm -f td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-13T05:56:36.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:713: TEST_ec_recovery_unfound: delete_erasure_coded_pool pool-jerasure 2026-02-13T05:56:36.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:56:36.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T05:56:36.696 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T05:56:36.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T05:56:36.978 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T05:56:36.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T05:56:36.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:56:36.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:56:36.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:56:36.987 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:56:36.987 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:56:36.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:56:36.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:56:36.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:56:37.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:56:37.097 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:56:37.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:56:37.098 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:56:37.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:56:37.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:56:37.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:56:37.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:56:37.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:56:37.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:56:37.102 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:56:37.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:56:37.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:56:37.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:56:37.123 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:56:37.123 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:37.123 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:37.123 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:56:37.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:56:37.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:56:37.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T05:56:37.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T05:56:37.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T05:56:37.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T05:56:37.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:56:37.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:56:37.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:56:37.126 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:56:37.126 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:56:37.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:56:37.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:56:37.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:56:37.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:56:37.127 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:56:37.127 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:56:37.128 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:56:37.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:56:37.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:56:37.129 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:56:37.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:56:37.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:56:37.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:56:37.131 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:56:37.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:56:37.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:56:37.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:56:37.134 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:56:37.134 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:37.134 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:37.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:56:37.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:56:37.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:56:37.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T05:56:37.136 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:56:37.136 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:37.136 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:37.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T05:56:37.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:56:37.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:56:37.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:56:37.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T05:56:37.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T05:56:37.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T05:56:37.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:56:37.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:56:37.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:56:37.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T05:56:37.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T05:56:37.159 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:56:37.159 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:56:37.159 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:56:37.160 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:56:37.160 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:37.160 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:37.160 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:37.161 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:56:37.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:56:37.188 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:56:37.188 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:56:37.188 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:56:37.188 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:56:37.188 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:56:37.189 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:56:37.189 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:56:37.190 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:56:37.190 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:56:37.190 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:37.190 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:37.190 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:56:37.190 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:56:37.190 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T05:56:37.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:56:37.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:56:37.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:56:37.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:56:37.236 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:56:37.237 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:56:37.237 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:56:37.237 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:56:37.237 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:56:37.237 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:37.237 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:37.237 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:56:37.237 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:56:37.237 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T05:56:37.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T05:56:37.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T05:56:37.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:56:37.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:56:37.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:56:37.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T05:56:37.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:56:37.381 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:56:37.382 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:56:37.382 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:56:37.382 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:56:37.382 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:37.382 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:37.382 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:37.383 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:56:37.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:56:37.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T05:56:37.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:56:37.499 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:56:37.505 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:56:38.508 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T05:56:38.508 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:56:38.508 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:56:38.508 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:56:38.508 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:38.508 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:38.508 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:56:38.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T05:56:38.509 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T05:56:38.550 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:56:38.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T05:56:38.556 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:56:37.179+0000 7f5eb4bf9d80 0 load: jerasure load: lrc 2026-02-13T05:56:38.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_single_recovery_error td/test-erasure-eio 2026-02-13T05:56:38.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:410: TEST_ec_single_recovery_error: local dir=td/test-erasure-eio 2026-02-13T05:56:38.557 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:411: TEST_ec_single_recovery_error: local objname=myobject 2026-02-13T05:56:38.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:413: TEST_ec_single_recovery_error: setup_osds 7 2026-02-13T05:56:38.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=7 2026-02-13T05:56:38.558 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T05:56:38.558 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 7 - 1 2026-02-13T05:56:38.558 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 6 2026-02-13T05:56:38.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:56:38.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T05:56:38.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:56:38.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:56:38.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:56:38.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:56:38.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T05:56:38.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:56:38.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:56:38.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:56:38.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:56:38.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T05:56:38.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T05:56:38.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:56:38.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:56:38.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:56:38.563 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:56:38.563 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:56:38.563 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:56:38.563 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:56:38.563 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:38.563 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:56:38.564 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:56:38.565 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T05:56:38.565 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:56:38.565 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1ebd6f5d-a70a-4b38-91a3-086d93ba6aee 2026-02-13T05:56:38.565 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1ebd6f5d-a70a-4b38-91a3-086d93ba6aee' 2026-02-13T05:56:38.566 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 1ebd6f5d-a70a-4b38-91a3-086d93ba6aee 2026-02-13T05:56:38.566 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:56:38.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAWvY5pgmEtIhAA/KtArjOZ5ElXJaLz1s8X/A== 2026-02-13T05:56:38.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAWvY5pgmEtIhAA/KtArjOZ5ElXJaLz1s8X/A=="}' 2026-02-13T05:56:38.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1ebd6f5d-a70a-4b38-91a3-086d93ba6aee -i td/test-erasure-eio/0/new.json 2026-02-13T05:56:38.679 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:56:38.686 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T05:56:38.686 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAWvY5pgmEtIhAA/KtArjOZ5ElXJaLz1s8X/A== --osd-uuid 1ebd6f5d-a70a-4b38-91a3-086d93ba6aee 2026-02-13T05:56:38.704 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:38.703+0000 7f33db497900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:38.706 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:38.704+0000 7f33db497900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:38.707 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:38.706+0000 7f33db497900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:38.708 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:38.706+0000 7f33db497900 -1 bdev(0x55ce20888c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:56:38.708 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:38.706+0000 7f33db497900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T05:56:39.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T05:56:39.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:56:39.118 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:56:39.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:56:39.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:56:39.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:56:39.225 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:56:39.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:56:39.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:56:39.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:56:39.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:56:39.242 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:39.241+0000 7fc1ac414900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:39.244 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:39.242+0000 7fc1ac414900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:39.245 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:39.243+0000 7fc1ac414900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:39.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:56:39.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:56:39.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:56:39.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:56:39.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:56:39.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:39.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:56:39.327 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:56:39.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:39.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:56:39.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:56:39.465 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:39.463+0000 7fc1ac414900 -1 Falling back to public interface 2026-02-13T05:56:39.753 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:39.752+0000 7fc1ac414900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:56:40.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:56:40.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:40.427 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:56:40.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:56:40.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:40.428 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:56:40.650 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4030602474,v1:127.0.0.1:6803/4030602474] [v2:127.0.0.1:6804/4030602474,v1:127.0.0.1:6805/4030602474] exists,up 1ebd6f5d-a70a-4b38-91a3-086d93ba6aee 2026-02-13T05:56:40.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:56:40.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:56:40.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:56:40.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:56:40.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T05:56:40.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:56:40.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:56:40.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:56:40.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:56:40.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:56:40.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:56:40.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:56:40.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:56:40.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:56:40.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:56:40.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:56:40.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:56:40.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:56:40.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:56:40.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:56:40.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:56:40.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:56:40.655 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:56:40.655 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:56:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:56:40.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:56:40.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:56:40.657 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:56:40.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a81bbae7-96c7-43bc-8b77-a9022707bd4d 2026-02-13T05:56:40.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 a81bbae7-96c7-43bc-8b77-a9022707bd4d' 2026-02-13T05:56:40.657 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 a81bbae7-96c7-43bc-8b77-a9022707bd4d 2026-02-13T05:56:40.658 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:56:40.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAYvY5p6qSkJxAAiwBnLt+ZABcFNsc1hrqsfg== 2026-02-13T05:56:40.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAYvY5p6qSkJxAAiwBnLt+ZABcFNsc1hrqsfg=="}' 2026-02-13T05:56:40.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a81bbae7-96c7-43bc-8b77-a9022707bd4d -i td/test-erasure-eio/1/new.json 2026-02-13T05:56:40.898 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:56:40.905 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T05:56:40.906 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAYvY5p6qSkJxAAiwBnLt+ZABcFNsc1hrqsfg== --osd-uuid a81bbae7-96c7-43bc-8b77-a9022707bd4d 2026-02-13T05:56:40.924 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:40.922+0000 7fd8d9610900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:40.925 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:40.924+0000 7fd8d9610900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:40.926 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:40.925+0000 7fd8d9610900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:40.927 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:40.925+0000 7fd8d9610900 -1 bdev(0x561fb9020c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:56:40.927 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:40.925+0000 7fd8d9610900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T05:56:41.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T05:56:41.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:56:41.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:56:41.258 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:56:41.258 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:56:41.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:56:41.568 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:56:41.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:56:41.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:56:41.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:56:41.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:56:41.585 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:41.583+0000 7fde43416900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:41.586 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:41.585+0000 7fde43416900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:41.587 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:41.586+0000 7fde43416900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:41.736 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:41.735+0000 7fde43416900 -1 Falling back to public interface 2026-02-13T05:56:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:56:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:56:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:56:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:56:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:56:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:41.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:56:41.790 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:56:41.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:41.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:56:42.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:56:42.087 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:42.085+0000 7fde43416900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:56:43.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:56:43.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:43.013 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:56:43.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:56:43.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:43.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:56:43.236 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1718182770,v1:127.0.0.1:6811/1718182770] [v2:127.0.0.1:6812/1718182770,v1:127.0.0.1:6813/1718182770] exists,up a81bbae7-96c7-43bc-8b77-a9022707bd4d 2026-02-13T05:56:43.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:56:43.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:56:43.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:56:43.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:56:43.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T05:56:43.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:56:43.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:56:43.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:56:43.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:56:43.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:56:43.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:56:43.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:56:43.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:56:43.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:56:43.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:56:43.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:56:43.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:56:43.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:56:43.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:56:43.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:56:43.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:56:43.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:56:43.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:56:43.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:56:43.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:56:43.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:56:43.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:56:43.242 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:56:43.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c5a2e352-ad9f-4444-9d62-79bd038365b8 2026-02-13T05:56:43.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 c5a2e352-ad9f-4444-9d62-79bd038365b8' 2026-02-13T05:56:43.243 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 c5a2e352-ad9f-4444-9d62-79bd038365b8 2026-02-13T05:56:43.244 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:56:43.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAbvY5pk6P9DhAAUlX9EACQtaUxNVn7OxvV4Q== 2026-02-13T05:56:43.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAbvY5pk6P9DhAAUlX9EACQtaUxNVn7OxvV4Q=="}' 2026-02-13T05:56:43.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c5a2e352-ad9f-4444-9d62-79bd038365b8 -i td/test-erasure-eio/2/new.json 2026-02-13T05:56:43.481 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:56:43.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T05:56:43.491 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAbvY5pk6P9DhAAUlX9EACQtaUxNVn7OxvV4Q== --osd-uuid c5a2e352-ad9f-4444-9d62-79bd038365b8 2026-02-13T05:56:43.509 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:43.507+0000 7f7e1900d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:43.510 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:43.509+0000 7f7e1900d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:43.511 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:43.510+0000 7f7e1900d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:43.512 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:43.510+0000 7f7e1900d900 -1 bdev(0x55981e946c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:56:43.512 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:43.510+0000 7f7e1900d900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T05:56:43.841 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T05:56:43.841 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:56:43.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:56:43.842 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:56:43.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:56:44.162 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:56:44.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:56:44.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:56:44.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:56:44.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:56:44.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:56:44.179 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:44.178+0000 7f71c2ff4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:44.181 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:44.179+0000 7f71c2ff4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:44.182 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:44.180+0000 7f71c2ff4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:44.335 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:44.333+0000 7f71c2ff4900 -1 Falling back to public interface 2026-02-13T05:56:44.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:56:44.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:56:44.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:56:44.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:56:44.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:56:44.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:44.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:56:44.390 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:56:44.390 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:44.390 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:56:44.614 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:56:44.636 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:44.635+0000 7f71c2ff4900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:56:45.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:56:45.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:45.616 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:56:45.616 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:56:45.617 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:45.617 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:56:45.849 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 17 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2630934000,v1:127.0.0.1:6819/2630934000] [v2:127.0.0.1:6820/2630934000,v1:127.0.0.1:6821/2630934000] exists,up c5a2e352-ad9f-4444-9d62-79bd038365b8 2026-02-13T05:56:45.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:56:45.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:56:45.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:56:45.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:56:45.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T05:56:45.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:56:45.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:56:45.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T05:56:45.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:56:45.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:56:45.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:56:45.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:45.854 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:45.855 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:45.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:45.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:56:45.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:56:45.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:56:45.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:56:45.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:56:45.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:56:45.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:56:45.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:56:45.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:56:45.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:56:45.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:56:45.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:56:45.856 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:56:45.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=07467950-102c-40fa-a136-46ed3a38b0a4 2026-02-13T05:56:45.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 07467950-102c-40fa-a136-46ed3a38b0a4' 2026-02-13T05:56:45.857 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 07467950-102c-40fa-a136-46ed3a38b0a4 2026-02-13T05:56:45.857 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:56:45.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAdvY5pMMWKMxAA1xnKrGvC6U07hMVSn71igA== 2026-02-13T05:56:45.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAdvY5pMMWKMxAA1xnKrGvC6U07hMVSn71igA=="}' 2026-02-13T05:56:45.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 07467950-102c-40fa-a136-46ed3a38b0a4 -i td/test-erasure-eio/3/new.json 2026-02-13T05:56:46.094 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T05:56:46.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T05:56:46.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAdvY5pMMWKMxAA1xnKrGvC6U07hMVSn71igA== --osd-uuid 07467950-102c-40fa-a136-46ed3a38b0a4 2026-02-13T05:56:46.121 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:46.119+0000 7f681e813900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:46.122 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:46.121+0000 7f681e813900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:46.123 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:46.122+0000 7f681e813900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:46.124 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:46.122+0000 7f681e813900 -1 bdev(0x5578e1e7ec00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T05:56:46.124 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:46.122+0000 7f681e813900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T05:56:46.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T05:56:46.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:56:46.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T05:56:46.446 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T05:56:46.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:56:46.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T05:56:46.761 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:56:46.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:56:46.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:56:46.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:56:46.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:56:46.778 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:46.776+0000 7fbc3fe0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:46.779 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:46.778+0000 7fbc3fe0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:46.780 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:46.779+0000 7fbc3fe0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:46.916 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:46.914+0000 7fbc3fe0d900 -1 Falling back to public interface 2026-02-13T05:56:46.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T05:56:46.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:56:46.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:56:46.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:56:46.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:56:46.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:46.986 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:56:46.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:56:46.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:46.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:56:47.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:56:47.270 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:47.268+0000 7fbc3fe0d900 -1 osd.3 0 log_to_monitors true 2026-02-13T05:56:48.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:56:48.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:48.210 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:56:48.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:56:48.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:48.210 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:56:48.433 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 25 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3932665233,v1:127.0.0.1:6827/3932665233] [v2:127.0.0.1:6828/3932665233,v1:127.0.0.1:6829/3932665233] exists,up 07467950-102c-40fa-a136-46ed3a38b0a4 2026-02-13T05:56:48.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:56:48.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:56:48.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:56:48.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:56:48.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-13T05:56:48.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:56:48.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:56:48.433 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:48.434 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:56:48.435 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-13T05:56:48.436 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:56:48.437 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8a195bf7-5c6b-43b1-83c5-127772726e63 2026-02-13T05:56:48.437 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 8a195bf7-5c6b-43b1-83c5-127772726e63' 2026-02-13T05:56:48.437 INFO:tasks.workunit.client.0.trial024.stdout:add osd4 8a195bf7-5c6b-43b1-83c5-127772726e63 2026-02-13T05:56:48.437 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:56:48.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAgvY5pF3K4GhAAuuZISGAHB6zFeHWhE/8zew== 2026-02-13T05:56:48.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAgvY5pF3K4GhAAuuZISGAHB6zFeHWhE/8zew=="}' 2026-02-13T05:56:48.449 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8a195bf7-5c6b-43b1-83c5-127772726e63 -i td/test-erasure-eio/4/new.json 2026-02-13T05:56:48.674 INFO:tasks.workunit.client.0.trial024.stdout:4 2026-02-13T05:56:48.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-13T05:56:48.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAgvY5pF3K4GhAAuuZISGAHB6zFeHWhE/8zew== --osd-uuid 8a195bf7-5c6b-43b1-83c5-127772726e63 2026-02-13T05:56:48.701 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:48.699+0000 7f50ca2e7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:48.702 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:48.701+0000 7f50ca2e7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:48.703 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:48.702+0000 7f50ca2e7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:48.703 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:48.702+0000 7f50ca2e7900 -1 bdev(0x55a3b3a4cc00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-13T05:56:48.703 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:48.702+0000 7f50ca2e7900 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-13T05:56:49.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-13T05:56:49.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:56:49.029 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-13T05:56:49.029 INFO:tasks.workunit.client.0.trial024.stdout:adding osd4 key to auth repository 2026-02-13T05:56:49.030 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:56:49.342 INFO:tasks.workunit.client.0.trial024.stdout:start osd.4 2026-02-13T05:56:49.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-13T05:56:49.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:56:49.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:56:49.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:56:49.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:56:49.359 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:49.358+0000 7ffb2cd56900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:49.360 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:49.359+0000 7ffb2cd56900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:49.361 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:49.360+0000 7ffb2cd56900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:49.496 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:49.494+0000 7ffb2cd56900 -1 Falling back to public interface 2026-02-13T05:56:49.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-13T05:56:49.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:56:49.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-13T05:56:49.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:56:49.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:56:49.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:49.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:56:49.567 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:56:49.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:49.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:56:49.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:56:49.852 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:49.851+0000 7ffb2cd56900 -1 osd.4 0 log_to_monitors true 2026-02-13T05:56:50.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:56:50.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:50.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:56:50.790 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:56:50.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:50.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-13T05:56:51.012 INFO:tasks.workunit.client.0.trial024.stdout:osd.4 up in weight 1 up_from 33 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/4094317778,v1:127.0.0.1:6835/4094317778] [v2:127.0.0.1:6836/4094317778,v1:127.0.0.1:6837/4094317778] exists,up 8a195bf7-5c6b-43b1-83c5-127772726e63 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:56:51.013 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:56:51.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:56:51.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:56:51.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:56:51.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:56:51.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-13T05:56:51.015 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:56:51.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c7ada76c-cadb-466b-bc4d-f7f32d3e9569 2026-02-13T05:56:51.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 c7ada76c-cadb-466b-bc4d-f7f32d3e9569' 2026-02-13T05:56:51.016 INFO:tasks.workunit.client.0.trial024.stdout:add osd5 c7ada76c-cadb-466b-bc4d-f7f32d3e9569 2026-02-13T05:56:51.016 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:56:51.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAjvY5pFWioARAA4JAx59WVolgVL+Zu400Hdw== 2026-02-13T05:56:51.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAjvY5pFWioARAA4JAx59WVolgVL+Zu400Hdw=="}' 2026-02-13T05:56:51.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c7ada76c-cadb-466b-bc4d-f7f32d3e9569 -i td/test-erasure-eio/5/new.json 2026-02-13T05:56:51.252 INFO:tasks.workunit.client.0.trial024.stdout:5 2026-02-13T05:56:51.260 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-13T05:56:51.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAjvY5pFWioARAA4JAx59WVolgVL+Zu400Hdw== --osd-uuid c7ada76c-cadb-466b-bc4d-f7f32d3e9569 2026-02-13T05:56:51.279 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:51.277+0000 7f9c27e14900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:51.280 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:51.279+0000 7f9c27e14900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:51.281 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:51.280+0000 7f9c27e14900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:51.281 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:51.280+0000 7f9c27e14900 -1 bdev(0x55fe7d21cc00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-13T05:56:51.281 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:51.280+0000 7f9c27e14900 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-13T05:56:51.601 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-13T05:56:51.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:56:51.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-13T05:56:51.603 INFO:tasks.workunit.client.0.trial024.stdout:adding osd5 key to auth repository 2026-02-13T05:56:51.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:56:51.912 INFO:tasks.workunit.client.0.trial024.stdout:start osd.5 2026-02-13T05:56:51.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-13T05:56:51.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:56:51.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:56:51.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:56:51.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:56:51.928 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:51.927+0000 7feb3120d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:51.930 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:51.928+0000 7feb3120d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:51.931 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:51.929+0000 7feb3120d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:52.055 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:52.053+0000 7feb3120d900 -1 Falling back to public interface 2026-02-13T05:56:52.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-13T05:56:52.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:56:52.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-13T05:56:52.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:56:52.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:56:52.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:52.134 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:56:52.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:56:52.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:52.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:56:52.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:56:52.378 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:52.376+0000 7feb3120d900 -1 osd.5 0 log_to_monitors true 2026-02-13T05:56:53.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:56:53.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:53.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:56:53.360 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:56:53.361 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:53.361 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-13T05:56:53.583 INFO:tasks.workunit.client.0.trial024.stdout:osd.5 up in weight 1 up_from 42 up_thru 43 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2838259441,v1:127.0.0.1:6843/2838259441] [v2:127.0.0.1:6844/2838259441,v1:127.0.0.1:6845/2838259441] exists,up c7ada76c-cadb-466b-bc4d-f7f32d3e9569 2026-02-13T05:56:53.586 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:56:53.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:56:53.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:56:53.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:56:53.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-13T05:56:53.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:56:53.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:56:53.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-13T05:56:53.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:56:53.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-13T05:56:53.587 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:56:53.588 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:53.589 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:53.589 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:53.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:56:53.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:56:53.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:56:53.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:56:53.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:56:53.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:56:53.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:56:53.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:56:53.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:56:53.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:56:53.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:56:53.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:56:53.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-13T05:56:53.590 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:56:53.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9a65774e-ec4a-475a-a8fb-49bf7d63cb73 2026-02-13T05:56:53.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 9a65774e-ec4a-475a-a8fb-49bf7d63cb73' 2026-02-13T05:56:53.590 INFO:tasks.workunit.client.0.trial024.stdout:add osd6 9a65774e-ec4a-475a-a8fb-49bf7d63cb73 2026-02-13T05:56:53.591 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:56:53.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAlvY5pLiylIxAAYwdzGAthhG9/JloYq3PpFQ== 2026-02-13T05:56:53.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAlvY5pLiylIxAAYwdzGAthhG9/JloYq3PpFQ=="}' 2026-02-13T05:56:53.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9a65774e-ec4a-475a-a8fb-49bf7d63cb73 -i td/test-erasure-eio/6/new.json 2026-02-13T05:56:53.827 INFO:tasks.workunit.client.0.trial024.stdout:6 2026-02-13T05:56:53.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-13T05:56:53.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAlvY5pLiylIxAAYwdzGAthhG9/JloYq3PpFQ== --osd-uuid 9a65774e-ec4a-475a-a8fb-49bf7d63cb73 2026-02-13T05:56:53.854 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:53.853+0000 7f4053822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:53.855 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:53.854+0000 7f4053822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:53.856 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:53.855+0000 7f4053822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:53.857 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:53.855+0000 7f4053822900 -1 bdev(0x55b8fe142c00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-13T05:56:53.857 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:53.855+0000 7f4053822900 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-13T05:56:54.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-13T05:56:54.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:56:54.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-13T05:56:54.185 INFO:tasks.workunit.client.0.trial024.stdout:adding osd6 key to auth repository 2026-02-13T05:56:54.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:56:54.499 INFO:tasks.workunit.client.0.trial024.stdout:start osd.6 2026-02-13T05:56:54.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-13T05:56:54.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:56:54.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:56:54.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:56:54.501 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:56:54.516 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:54.515+0000 7fa008e6b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:54.518 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:54.516+0000 7fa008e6b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:54.518 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:54.517+0000 7fa008e6b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:56:54.655 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:54.653+0000 7fa008e6b900 -1 Falling back to public interface 2026-02-13T05:56:54.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-13T05:56:54.727 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:56:54.727 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-13T05:56:54.727 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:56:54.727 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:56:54.727 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:54.727 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:56:54.728 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:56:54.728 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:54.728 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:56:54.951 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:56:54.965 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:56:54.964+0000 7fa008e6b900 -1 osd.6 0 log_to_monitors true 2026-02-13T05:56:55.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:56:55.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:56:55.952 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:56:55.953 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:56:55.953 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:56:55.953 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-13T05:56:56.178 INFO:tasks.workunit.client.0.trial024.stdout:osd.6 up in weight 1 up_from 50 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/3881519584,v1:127.0.0.1:6851/3881519584] [v2:127.0.0.1:6852/3881519584,v1:127.0.0.1:6853/3881519584] exists,up 9a65774e-ec4a-475a-a8fb-49bf7d63cb73 2026-02-13T05:56:56.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:56:56.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:56:56.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:56:56.180 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T05:56:56.180 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:56:56.180 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:56:56.180 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:56:56.181 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:56:56.181 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:56:56.181 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:56:56.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T05:56:56.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T05:56:56.227 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:56:56.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T05:56:56.234 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:56:39.466+0000 7fc1ac414900 0 load: jerasure load: lrc 2026-02-13T05:56:56.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:415: TEST_ec_single_recovery_error: local poolname=pool-jerasure 2026-02-13T05:56:56.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:416: TEST_ec_single_recovery_error: create_erasure_coded_pool pool-jerasure 3 2 2026-02-13T05:56:56.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:56:56.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T05:56:56.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-13T05:56:56.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T05:56:56.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-13T05:56:56.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T05:56:56.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-13T05:56:56.526 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T05:56:56.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T05:56:56.902 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T05:56:56.910 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:56:57.912 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T05:56:57.912 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:56:57.912 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:56:57.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:56:57.914 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:56:57.914 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:56:57.914 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:56:57.914 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:56:57.914 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:56:57.914 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:56:58.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:56:58.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:56:58.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:56:58.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:56:58.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:56:58.000 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:56:58.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:56:58.226 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:56:58.226 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:56:58.226 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:56:58.226 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:56:58.227 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:56:58.227 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:56:58.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:56:58.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:58.227 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:56:58.290 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803782 2026-02-13T05:56:58.290 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803782 2026-02-13T05:56:58.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782' 2026-02-13T05:56:58.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:58.291 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:56:58.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607558 2026-02-13T05:56:58.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607558 2026-02-13T05:56:58.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558' 2026-02-13T05:56:58.357 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:58.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:56:58.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444037 2026-02-13T05:56:58.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444037 2026-02-13T05:56:58.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-73014444037' 2026-02-13T05:56:58.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:58.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:56:58.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182405 2026-02-13T05:56:58.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182405 2026-02-13T05:56:58.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-73014444037 3-107374182405' 2026-02-13T05:56:58.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:58.486 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:56:58.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920772 2026-02-13T05:56:58.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920772 2026-02-13T05:56:58.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-73014444037 3-107374182405 4-141733920772' 2026-02-13T05:56:58.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:58.548 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:56:58.613 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626436 2026-02-13T05:56:58.614 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626436 2026-02-13T05:56:58.614 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-73014444037 3-107374182405 4-141733920772 5-180388626436' 2026-02-13T05:56:58.614 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:56:58.614 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:56:58.676 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364803 2026-02-13T05:56:58.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364803 2026-02-13T05:56:58.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803782 1-51539607558 2-73014444037 3-107374182405 4-141733920772 5-180388626436 6-214748364803' 2026-02-13T05:56:58.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:56:58.677 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803782 2026-02-13T05:56:58.678 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:56:58.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:56:58.679 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803782 2026-02-13T05:56:58.679 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:56:58.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803782 2026-02-13T05:56:58.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803782' 2026-02-13T05:56:58.680 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803782 2026-02-13T05:56:58.680 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:56:58.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803780 -lt 25769803782 2026-02-13T05:56:58.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:56:59.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:56:59.904 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:00.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803782 2026-02-13T05:57:00.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:00.128 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607558 2026-02-13T05:57:00.129 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:00.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:57:00.130 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607558 2026-02-13T05:57:00.130 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:00.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607558 2026-02-13T05:57:00.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607558' 2026-02-13T05:57:00.132 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607558 2026-02-13T05:57:00.132 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:57:00.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607558 -lt 51539607558 2026-02-13T05:57:00.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:00.359 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444037 2026-02-13T05:57:00.360 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:00.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:57:00.361 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444037 2026-02-13T05:57:00.361 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:00.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444037 2026-02-13T05:57:00.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444037' 2026-02-13T05:57:00.363 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 73014444037 2026-02-13T05:57:00.363 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:57:00.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444037 -lt 73014444037 2026-02-13T05:57:00.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:00.597 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182405 2026-02-13T05:57:00.597 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:00.598 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:57:00.598 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182405 2026-02-13T05:57:00.598 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:00.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182405 2026-02-13T05:57:00.600 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182405' 2026-02-13T05:57:00.600 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 107374182405 2026-02-13T05:57:00.601 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:57:00.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182405 -lt 107374182405 2026-02-13T05:57:00.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:00.824 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-141733920772 2026-02-13T05:57:00.825 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:00.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:57:00.826 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-141733920772 2026-02-13T05:57:00.826 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:00.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920772 2026-02-13T05:57:00.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 141733920772' 2026-02-13T05:57:00.827 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 141733920772 2026-02-13T05:57:00.828 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:57:01.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920772 -lt 141733920772 2026-02-13T05:57:01.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:01.052 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-180388626436 2026-02-13T05:57:01.052 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:01.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:57:01.053 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-180388626436 2026-02-13T05:57:01.053 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:01.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=180388626436 2026-02-13T05:57:01.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 180388626436' 2026-02-13T05:57:01.055 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 180388626436 2026-02-13T05:57:01.055 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:57:01.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 180388626436 -lt 180388626436 2026-02-13T05:57:01.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:01.286 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-214748364803 2026-02-13T05:57:01.286 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:01.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=6 2026-02-13T05:57:01.288 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 6-214748364803 2026-02-13T05:57:01.288 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:01.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=214748364803 2026-02-13T05:57:01.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.6 seq 214748364803' 2026-02-13T05:57:01.289 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.6 seq 214748364803 2026-02-13T05:57:01.289 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-13T05:57:01.509 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 214748364804 -lt 214748364803 2026-02-13T05:57:01.510 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:57:01.510 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:01.510 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:01.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:57:01.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:57:01.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:57:01.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:57:01.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:57:01.833 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:57:01.833 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:57:01.833 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:57:02.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:57:02.051 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:57:02.052 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:02.052 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:02.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:57:02.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:57:02.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:57:02.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:418: TEST_ec_single_recovery_error: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-13T05:57:02.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:57:02.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:57:02.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-13T05:57:02.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:02.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:57:02.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:02.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:57:02.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:02.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:57:02.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:02.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:57:02.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-13T05:57:02.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:419: TEST_ec_single_recovery_error: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 0 2026-02-13T05:57:02.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T05:57:02.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T05:57:02.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T05:57:02.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T05:57:02.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T05:57:02.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T05:57:02.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=myobject 2026-02-13T05:57:02.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T05:57:02.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T05:57:02.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T05:57:02.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-13T05:57:02.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T05:57:02.380 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure myobject 2026-02-13T05:57:02.380 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:57:02.381 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-13T05:57:02.381 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-13T05:57:02.381 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:57:02.607 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:57:02.607 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:57:02.607 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:02.607 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:57:02.607 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:57:02.608 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2026-02-13T05:57:02.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '5' '1' '0' '6') 2026-02-13T05:57:02.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T05:57:02.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-13T05:57:02.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T05:57:02.609 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-13T05:57:02.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T05:57:02.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-13T05:57:02.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T05:57:02.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-13T05:57:02.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T05:57:02.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T05:57:02.609 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T05:57:02.611 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-13T05:57:02.611 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T05:57:02.611 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T05:57:02.611 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:57:02.611 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:02.611 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:02.611 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T05:57:02.611 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-13T05:57:02.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T05:57:02.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T05:57:02.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T05:57:02.661 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-13T05:57:02.661 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T05:57:02.661 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T05:57:02.661 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:57:02.661 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:02.661 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:02.661 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T05:57:02.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T05:57:02.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.3.asok injectdataerr pool-jerasure myobject 0 2026-02-13T05:57:02.710 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:421: TEST_ec_single_recovery_error: get_osds pool-jerasure myobject 2026-02-13T05:57:02.711 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:57:02.711 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=myobject 2026-02-13T05:57:02.711 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-13T05:57:02.711 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:57:02.936 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:57:02.936 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:57:02.936 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:02.936 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:57:02.936 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:57:02.936 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 1 0 6 2026-02-13T05:57:02.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:421: TEST_ec_single_recovery_error: initial_osds=('3' '5' '1' '0' '6') 2026-02-13T05:57:02.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:421: TEST_ec_single_recovery_error: local -a initial_osds 2026-02-13T05:57:02.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:422: TEST_ec_single_recovery_error: local last_osd=6 2026-02-13T05:57:02.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:424: TEST_ec_single_recovery_error: kill_daemons td/test-erasure-eio TERM osd.6 2026-02-13T05:57:02.938 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:57:02.938 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:57:02.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:57:02.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:57:02.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:57:03.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:57:03.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:425: TEST_ec_single_recovery_error: ceph osd down 6 2026-02-13T05:57:03.466 INFO:tasks.workunit.client.0.trial024.stderr:osd.6 is already down. 2026-02-13T05:57:03.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:426: TEST_ec_single_recovery_error: ceph osd out 6 2026-02-13T05:57:03.721 INFO:tasks.workunit.client.0.trial024.stderr:osd.6 is already out. 2026-02-13T05:57:03.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:429: TEST_ec_single_recovery_error: wait_for_clean 2026-02-13T05:57:03.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:57:03.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:57:03.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:57:03.731 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:57:03.731 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:57:03.731 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:57:03.731 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:57:03.731 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:57:03.731 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:57:03.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:57:03.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:57:03.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:57:03.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:57:03.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:57:03.817 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:57:04.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:57:04.040 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:04.040 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:57:04.040 INFO:tasks.workunit.client.0.trial024.stderr:3 2026-02-13T05:57:04.041 INFO:tasks.workunit.client.0.trial024.stderr:4 2026-02-13T05:57:04.041 INFO:tasks.workunit.client.0.trial024.stderr:5 2026-02-13T05:57:04.041 INFO:tasks.workunit.client.0.trial024.stderr:6' 2026-02-13T05:57:04.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:57:04.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:04.041 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:57:04.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803785 2026-02-13T05:57:04.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803785 2026-02-13T05:57:04.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785' 2026-02-13T05:57:04.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:04.103 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:57:04.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607561 2026-02-13T05:57:04.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607561 2026-02-13T05:57:04.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561' 2026-02-13T05:57:04.167 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:04.167 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:57:04.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444040 2026-02-13T05:57:04.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444040 2026-02-13T05:57:04.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-73014444040' 2026-02-13T05:57:04.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:04.231 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:57:04.295 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182408 2026-02-13T05:57:04.296 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182408 2026-02-13T05:57:04.296 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-73014444040 3-107374182408' 2026-02-13T05:57:04.296 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:04.296 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-13T05:57:04.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920775 2026-02-13T05:57:04.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920775 2026-02-13T05:57:04.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-73014444040 3-107374182408 4-141733920775' 2026-02-13T05:57:04.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:04.359 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-13T05:57:04.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626439 2026-02-13T05:57:04.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626439 2026-02-13T05:57:04.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803785 1-51539607561 2-73014444040 3-107374182408 4-141733920775 5-180388626439' 2026-02-13T05:57:04.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:04.424 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-13T05:57:04.468 INFO:tasks.workunit.client.0.trial024.stderr:Error ENXIO: problem getting command descriptions from osd.6 2026-02-13T05:57:04.469 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T05:57:04.469 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T05:57:04.469 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-13T05:57:04.469 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:04.469 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803785 2026-02-13T05:57:04.470 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:04.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:57:04.471 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803785 2026-02-13T05:57:04.471 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:04.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803785 2026-02-13T05:57:04.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-13T05:57:04.472 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803785 2026-02-13T05:57:04.472 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:04.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803783 -lt 25769803785 2026-02-13T05:57:04.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:57:05.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:57:05.698 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:05.930 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803785 -lt 25769803785 2026-02-13T05:57:05.930 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:05.930 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607561 2026-02-13T05:57:05.930 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:05.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:57:05.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607561 2026-02-13T05:57:05.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:05.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607561 2026-02-13T05:57:05.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607561' 2026-02-13T05:57:05.934 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607561 2026-02-13T05:57:05.934 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:57:06.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607561 -lt 51539607561 2026-02-13T05:57:06.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:06.159 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444040 2026-02-13T05:57:06.159 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:06.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:57:06.160 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444040 2026-02-13T05:57:06.161 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:06.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444040 2026-02-13T05:57:06.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444040' 2026-02-13T05:57:06.162 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 73014444040 2026-02-13T05:57:06.162 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:57:06.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444040 -lt 73014444040 2026-02-13T05:57:06.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:06.383 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182408 2026-02-13T05:57:06.383 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:06.384 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:57:06.385 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182408 2026-02-13T05:57:06.385 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:06.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182408 2026-02-13T05:57:06.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182408' 2026-02-13T05:57:06.387 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 107374182408 2026-02-13T05:57:06.387 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:57:06.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182408 -lt 107374182408 2026-02-13T05:57:06.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:06.612 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-141733920775 2026-02-13T05:57:06.612 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:06.613 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=4 2026-02-13T05:57:06.613 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 4-141733920775 2026-02-13T05:57:06.614 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:06.614 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920775 2026-02-13T05:57:06.615 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.4 seq 141733920775' 2026-02-13T05:57:06.615 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.4 seq 141733920775 2026-02-13T05:57:06.615 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-13T05:57:06.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920775 -lt 141733920775 2026-02-13T05:57:06.841 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:06.841 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-180388626439 2026-02-13T05:57:06.841 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:06.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=5 2026-02-13T05:57:06.843 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 5-180388626439 2026-02-13T05:57:06.843 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:06.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=180388626439 2026-02-13T05:57:06.844 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.5 seq 180388626439' 2026-02-13T05:57:06.844 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.5 seq 180388626439 2026-02-13T05:57:06.845 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-13T05:57:07.070 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 180388626439 -lt 180388626439 2026-02-13T05:57:07.070 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:57:07.071 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:07.071 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:07.382 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:57:07.382 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:57:07.383 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:57:07.384 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:57:07.384 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:57:07.384 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:57:07.384 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:57:07.384 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:57:07.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-13T05:57:07.607 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:57:07.607 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:07.607 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:07.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 5 2026-02-13T05:57:07.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 4 '!=' -1 2026-02-13T05:57:07.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T05:57:07.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=4 2026-02-13T05:57:07.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T05:57:07.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T05:57:08.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T05:57:08.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:57:08.015 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:57:08.016 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:57:08.016 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:57:08.016 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:57:08.016 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:57:08.016 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:57:08.234 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-13T05:57:08.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:57:08.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:08.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:08.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 5 2026-02-13T05:57:08.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 4 '!=' 4 2026-02-13T05:57:08.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T05:57:08.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T05:57:08.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T05:57:08.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T05:57:08.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T05:57:08.546 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T05:57:08.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T05:57:08.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T05:57:08.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T05:57:08.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 13 )) 2026-02-13T05:57:08.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T05:57:08.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T05:57:09.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T05:57:09.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:57:09.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:57:09.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:57:09.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:57:09.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:57:09.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:57:09.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:57:09.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-13T05:57:09.280 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:57:09.281 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:09.281 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:09.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 5 2026-02-13T05:57:09.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 4 '!=' 4 2026-02-13T05:57:09.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T05:57:09.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T05:57:09.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T05:57:09.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T05:57:09.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T05:57:09.607 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T05:57:09.608 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T05:57:09.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=708 2026-02-13T05:57:09.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 708 '!=' null 2026-02-13T05:57:09.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1668: wait_for_clean: loop=0 2026-02-13T05:57:09.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T05:57:09.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T05:57:10.019 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T05:57:10.020 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:57:10.021 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:57:10.021 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:57:10.021 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:57:10.021 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:57:10.021 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:57:10.021 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:57:10.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:57:10.237 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:57:10.238 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:10.238 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:10.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:57:10.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:57:10.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:57:10.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:431: TEST_ec_single_recovery_error: rados_get td/test-erasure-eio pool-jerasure myobject 2026-02-13T05:57:10.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:57:10.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:57:10.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=myobject 2026-02-13T05:57:10.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:57:10.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:57:10.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get myobject td/test-erasure-eio/COPY 2026-02-13T05:57:10.566 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:57:10.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:57:10.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:433: TEST_ec_single_recovery_error: delete_erasure_coded_pool pool-jerasure 2026-02-13T05:57:10.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:57:10.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T05:57:10.839 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T05:57:10.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T05:57:11.119 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T05:57:11.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T05:57:11.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:57:11.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:57:11.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:57:11.129 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:57:11.129 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:57:11.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:57:11.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:57:11.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:57:11.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:57:11.242 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:57:11.243 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:57:11.243 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:57:11.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:57:11.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:57:11.244 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:57:11.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:57:11.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:57:11.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:57:11.246 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:57:11.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:57:11.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:57:11.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:57:11.261 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:57:11.261 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:11.261 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:11.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:57:11.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:57:11.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:57:11.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T05:57:11.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T05:57:11.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T05:57:11.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T05:57:11.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:57:11.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:57:11.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:57:11.264 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:57:11.264 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:57:11.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:57:11.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:57:11.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:57:11.265 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:57:11.265 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:57:11.265 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:57:11.266 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:57:11.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:57:11.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:57:11.267 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:57:11.268 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:57:11.268 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:57:11.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:57:11.269 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:57:11.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:57:11.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:57:11.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:57:11.271 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:57:11.272 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:11.272 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:11.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:57:11.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:57:11.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:57:11.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T05:57:11.274 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:57:11.274 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:11.274 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:11.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T05:57:11.275 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:57:11.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:57:11.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:57:11.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T05:57:11.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T05:57:11.276 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T05:57:11.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:57:11.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:57:11.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:57:11.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T05:57:11.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T05:57:11.297 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:57:11.298 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:57:11.298 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:57:11.298 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:57:11.298 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:11.298 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:11.298 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:11.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:57:11.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:57:11.325 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:57:11.325 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:57:11.325 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:57:11.325 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:57:11.327 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:57:11.327 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:57:11.327 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:57:11.327 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:57:11.327 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:57:11.327 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:11.327 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:11.327 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:57:11.327 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:57:11.328 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T05:57:11.371 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:57:11.371 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:57:11.371 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:57:11.371 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:57:11.371 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:57:11.372 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:57:11.373 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:57:11.373 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:57:11.373 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:57:11.373 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:11.373 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:11.373 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:57:11.373 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:57:11.373 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T05:57:11.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T05:57:11.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T05:57:11.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:57:11.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:57:11.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:57:11.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T05:57:11.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:57:11.519 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:57:11.519 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:57:11.519 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:57:11.519 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:57:11.519 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:11.519 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:11.519 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:11.520 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:57:11.520 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:57:11.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T05:57:11.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:57:11.633 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:57:11.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:57:12.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T05:57:12.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:57:12.642 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:57:12.642 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:57:12.642 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:12.642 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:12.643 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:57:12.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T05:57:12.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T05:57:12.683 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:57:12.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T05:57:12.689 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:57:11.316+0000 7fc6dd9cdd80 0 load: jerasure load: lrc 2026-02-13T05:57:12.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_bad_size_shard_0 td/test-erasure-eio 2026-02-13T05:57:12.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:322: TEST_rados_get_bad_size_shard_0: local dir=td/test-erasure-eio 2026-02-13T05:57:12.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:323: TEST_rados_get_bad_size_shard_0: setup_osds 4 2026-02-13T05:57:12.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-13T05:57:12.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T05:57:12.690 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-13T05:57:12.690 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-13T05:57:12.694 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:57:12.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T05:57:12.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:57:12.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:57:12.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:57:12.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:57:12.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T05:57:12.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:57:12.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:57:12.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:57:12.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:57:12.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:12.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:57:12.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:57:12.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:57:12.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:57:12.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:57:12.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:57:12.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:57:12.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:57:12.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:57:12.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:57:12.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:57:12.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T05:57:12.697 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:57:12.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d5073c47-8976-4cd5-921f-e4fdc15852b3 2026-02-13T05:57:12.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d5073c47-8976-4cd5-921f-e4fdc15852b3' 2026-02-13T05:57:12.698 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 d5073c47-8976-4cd5-921f-e4fdc15852b3 2026-02-13T05:57:12.698 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:57:12.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA4vY5p/voTKhAAkpA0S2jlPNuFb3hSpQW84Q== 2026-02-13T05:57:12.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA4vY5p/voTKhAAkpA0S2jlPNuFb3hSpQW84Q=="}' 2026-02-13T05:57:12.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d5073c47-8976-4cd5-921f-e4fdc15852b3 -i td/test-erasure-eio/0/new.json 2026-02-13T05:57:12.810 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:57:12.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T05:57:12.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA4vY5p/voTKhAAkpA0S2jlPNuFb3hSpQW84Q== --osd-uuid d5073c47-8976-4cd5-921f-e4fdc15852b3 2026-02-13T05:57:12.835 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:12.834+0000 7f4e810f6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:12.836 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:12.836+0000 7f4e810f6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:12.837 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:12.837+0000 7f4e810f6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:12.838 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:12.837+0000 7f4e810f6900 -1 bdev(0x55ad8124ec00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:57:12.838 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:12.837+0000 7f4e810f6900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T05:57:13.260 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T05:57:13.260 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:57:13.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:57:13.261 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:57:13.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:57:13.366 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:57:13.367 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:57:13.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:57:13.368 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:57:13.368 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:57:13.368 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:57:13.385 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:13.384+0000 7f188460f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:13.386 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:13.386+0000 7f188460f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:13.387 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:13.387+0000 7f188460f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:13.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:57:13.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:57:13.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:57:13.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:57:13.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:57:13.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:13.464 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:57:13.464 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:57:13.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:13.465 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:57:13.561 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:57:13.607 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:13.606+0000 7f188460f900 -1 Falling back to public interface 2026-02-13T05:57:13.871 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:13.871+0000 7f188460f900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:57:14.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:57:14.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:14.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:57:14.563 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:57:14.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:57:14.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:14.787 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/831634423,v1:127.0.0.1:6803/831634423] [v2:127.0.0.1:6804/831634423,v1:127.0.0.1:6805/831634423] exists,up d5073c47-8976-4cd5-921f-e4fdc15852b3 2026-02-13T05:57:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:57:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:57:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:57:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:57:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T05:57:14.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:57:14.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:57:14.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:57:14.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:57:14.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:57:14.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:57:14.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:57:14.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:57:14.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:57:14.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:57:14.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:57:14.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:57:14.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:57:14.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:57:14.792 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:57:14.792 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:57:14.792 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:57:14.792 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:57:14.792 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:14.792 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:14.792 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:14.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:14.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:57:14.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:57:14.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:57:14.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:57:14.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:57:14.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:57:14.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:57:14.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:57:14.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:57:14.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:57:14.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:57:14.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:57:14.793 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:57:14.794 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=dc0d2834-1486-4fda-a8bc-0945f2d718fb 2026-02-13T05:57:14.794 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 dc0d2834-1486-4fda-a8bc-0945f2d718fb' 2026-02-13T05:57:14.794 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 dc0d2834-1486-4fda-a8bc-0945f2d718fb 2026-02-13T05:57:14.795 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:57:14.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA6vY5pY2faLxAAaXGVivRcTnGHeFYP7kwKuQ== 2026-02-13T05:57:14.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA6vY5pY2faLxAAaXGVivRcTnGHeFYP7kwKuQ=="}' 2026-02-13T05:57:14.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new dc0d2834-1486-4fda-a8bc-0945f2d718fb -i td/test-erasure-eio/1/new.json 2026-02-13T05:57:15.029 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:57:15.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T05:57:15.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA6vY5pY2faLxAAaXGVivRcTnGHeFYP7kwKuQ== --osd-uuid dc0d2834-1486-4fda-a8bc-0945f2d718fb 2026-02-13T05:57:15.056 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:15.055+0000 7fbfadaff900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:15.057 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:15.057+0000 7fbfadaff900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:15.058 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:15.058+0000 7fbfadaff900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:15.059 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:15.058+0000 7fbfadaff900 -1 bdev(0x55eec0202c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:57:15.059 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:15.058+0000 7fbfadaff900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T05:57:15.391 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T05:57:15.391 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:57:15.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:57:15.392 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:57:15.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:57:15.705 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:57:15.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:57:15.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:57:15.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:57:15.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:57:15.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:57:15.721 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:15.720+0000 7f01097a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:15.722 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:15.722+0000 7f01097a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:15.723 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:15.723+0000 7f01097a1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:15.863 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:15.862+0000 7f01097a1900 -1 Falling back to public interface 2026-02-13T05:57:15.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:57:15.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:57:15.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:57:15.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:57:15.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:57:15.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:15.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:57:15.926 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:57:15.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:15.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:57:16.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:57:16.168 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:16.167+0000 7f01097a1900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:57:17.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:57:17.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:17.164 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:57:17.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:57:17.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:17.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:57:17.392 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1307825311,v1:127.0.0.1:6811/1307825311] [v2:127.0.0.1:6812/1307825311,v1:127.0.0.1:6813/1307825311] exists,up dc0d2834-1486-4fda-a8bc-0945f2d718fb 2026-02-13T05:57:17.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:57:17.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:57:17.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:57:17.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:57:17.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T05:57:17.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:57:17.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:57:17.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:57:17.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:57:17.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:57:17.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:57:17.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:57:17.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:57:17.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:57:17.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:57:17.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:57:17.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:57:17.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:57:17.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:57:17.398 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:57:17.398 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:57:17.398 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:57:17.398 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:57:17.398 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:17.398 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:17.398 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:17.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:17.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:57:17.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:57:17.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:57:17.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:57:17.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:57:17.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:57:17.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:57:17.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:57:17.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:57:17.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:57:17.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:57:17.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:57:17.400 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:57:17.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b6718de0-4c69-4c4a-bb8d-d6322e7ed4cf 2026-02-13T05:57:17.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 b6718de0-4c69-4c4a-bb8d-d6322e7ed4cf' 2026-02-13T05:57:17.400 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 b6718de0-4c69-4c4a-bb8d-d6322e7ed4cf 2026-02-13T05:57:17.400 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:57:17.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA9vY5pGmpKGBAAtO+VIP+jDpdQBBvOjjH8Fw== 2026-02-13T05:57:17.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA9vY5pGmpKGBAAtO+VIP+jDpdQBBvOjjH8Fw=="}' 2026-02-13T05:57:17.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b6718de0-4c69-4c4a-bb8d-d6322e7ed4cf -i td/test-erasure-eio/2/new.json 2026-02-13T05:57:17.633 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:57:17.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T05:57:17.642 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA9vY5pGmpKGBAAtO+VIP+jDpdQBBvOjjH8Fw== --osd-uuid b6718de0-4c69-4c4a-bb8d-d6322e7ed4cf 2026-02-13T05:57:17.660 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:17.659+0000 7f6b8e364900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:17.661 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:17.661+0000 7f6b8e364900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:17.662 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:17.662+0000 7f6b8e364900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:17.663 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:17.662+0000 7f6b8e364900 -1 bdev(0x563f74224c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:57:17.663 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:17.662+0000 7f6b8e364900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T05:57:17.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T05:57:17.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:57:17.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:57:17.977 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:57:17.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:57:18.301 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:57:18.302 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:57:18.302 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:57:18.302 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:57:18.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:57:18.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:57:18.319 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:18.318+0000 7f996da0e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:18.320 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:18.319+0000 7f996da0e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:18.321 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:18.320+0000 7f996da0e900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:18.456 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:18.456+0000 7f996da0e900 -1 Falling back to public interface 2026-02-13T05:57:18.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:57:18.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:57:18.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:57:18.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:57:18.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:57:18.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:18.524 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:57:18.525 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:57:18.525 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:18.525 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:57:18.750 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:18.749+0000 7f996da0e900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:57:18.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:57:19.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:57:19.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:19.754 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:57:19.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:57:19.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:19.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:57:19.978 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 19 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2268481796,v1:127.0.0.1:6819/2268481796] [v2:127.0.0.1:6820/2268481796,v1:127.0.0.1:6821/2268481796] exists,up b6718de0-4c69-4c4a-bb8d-d6322e7ed4cf 2026-02-13T05:57:19.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:57:19.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:57:19.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:57:19.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:57:19.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T05:57:19.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:57:19.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:57:19.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T05:57:19.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:57:19.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:57:19.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:57:19.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:57:19.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:57:19.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:57:19.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:57:19.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:57:19.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:57:19.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:57:19.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:57:19.983 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:57:19.983 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:57:19.983 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:57:19.983 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:57:19.984 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:19.984 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:19.984 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:19.984 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:19.984 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:57:19.984 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:57:19.984 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:57:19.984 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:57:19.984 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:57:19.984 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:57:19.984 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:57:19.984 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:57:19.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:57:19.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:57:19.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:57:19.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:57:19.985 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:57:19.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=83d51774-3260-4495-bb24-73733db8e2b9 2026-02-13T05:57:19.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 83d51774-3260-4495-bb24-73733db8e2b9' 2026-02-13T05:57:19.985 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 83d51774-3260-4495-bb24-73733db8e2b9 2026-02-13T05:57:19.986 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:57:19.993 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA/vY5pPk4oOxAA462pFuv+64hGqqX4DOxLEw== 2026-02-13T05:57:19.993 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA/vY5pPk4oOxAA462pFuv+64hGqqX4DOxLEw=="}' 2026-02-13T05:57:19.993 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 83d51774-3260-4495-bb24-73733db8e2b9 -i td/test-erasure-eio/3/new.json 2026-02-13T05:57:20.218 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T05:57:20.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T05:57:20.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA/vY5pPk4oOxAA462pFuv+64hGqqX4DOxLEw== --osd-uuid 83d51774-3260-4495-bb24-73733db8e2b9 2026-02-13T05:57:20.246 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:20.245+0000 7f6b59703900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:20.247 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:20.247+0000 7f6b59703900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:20.248 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:20.248+0000 7f6b59703900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:20.249 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:20.248+0000 7f6b59703900 -1 bdev(0x55b6be6f6c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T05:57:20.249 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:20.248+0000 7f6b59703900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T05:57:20.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T05:57:20.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:57:20.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T05:57:20.555 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T05:57:20.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:57:20.873 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:57:20.874 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T05:57:20.874 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:57:20.874 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:57:20.874 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:57:20.874 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:57:20.890 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:20.889+0000 7f8bdbeb2900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:20.891 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:20.891+0000 7f8bdbeb2900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:20.892 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:20.892+0000 7f8bdbeb2900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:21.026 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:21.025+0000 7f8bdbeb2900 -1 Falling back to public interface 2026-02-13T05:57:21.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T05:57:21.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:57:21.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:57:21.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:57:21.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:57:21.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:21.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:57:21.097 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:57:21.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:21.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:57:21.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:57:21.369 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:21.368+0000 7f8bdbeb2900 -1 osd.3 0 log_to_monitors true 2026-02-13T05:57:22.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:57:22.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:22.323 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:57:22.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:57:22.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:22.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:57:22.553 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 26 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3612756619,v1:127.0.0.1:6827/3612756619] [v2:127.0.0.1:6828/3612756619,v1:127.0.0.1:6829/3612756619] exists,up 83d51774-3260-4495-bb24-73733db8e2b9 2026-02-13T05:57:22.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:57:22.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:57:22.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:57:22.555 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T05:57:22.555 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:57:22.555 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:57:22.555 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:57:22.555 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:22.555 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:22.555 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:57:22.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T05:57:22.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T05:57:22.600 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:57:22.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T05:57:22.605 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:57:13.610+0000 7f188460f900 0 load: jerasure load: lrc 2026-02-13T05:57:22.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:325: TEST_rados_get_bad_size_shard_0: local poolname=pool-jerasure 2026-02-13T05:57:22.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:326: TEST_rados_get_bad_size_shard_0: create_erasure_coded_pool pool-jerasure 2 1 2026-02-13T05:57:22.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:57:22.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T05:57:22.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-13T05:57:22.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T05:57:22.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-13T05:57:22.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T05:57:22.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-13T05:57:22.885 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T05:57:22.886 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T05:57:23.257 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T05:57:23.265 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:57:24.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T05:57:24.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:57:24.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:57:24.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:57:24.268 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:57:24.268 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:57:24.268 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:57:24.268 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:57:24.268 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:57:24.268 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:57:24.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:57:24.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:57:24.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:57:24.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:57:24.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:57:24.356 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:57:24.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:57:24.592 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:24.592 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:57:24.592 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:57:24.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:57:24.592 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:24.592 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:57:24.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803780 2026-02-13T05:57:24.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803780 2026-02-13T05:57:24.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780' 2026-02-13T05:57:24.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:24.658 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:57:24.722 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-13T05:57:24.722 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-13T05:57:24.722 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852' 2026-02-13T05:57:24.722 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:24.722 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:57:24.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378627 2026-02-13T05:57:24.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378627 2026-02-13T05:57:24.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852 2-81604378627' 2026-02-13T05:57:24.787 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:24.787 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:57:24.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149700 2026-02-13T05:57:24.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149700 2026-02-13T05:57:24.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852 2-81604378627 3-111669149700' 2026-02-13T05:57:24.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:24.853 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803780 2026-02-13T05:57:24.853 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:24.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:57:24.854 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803780 2026-02-13T05:57:24.854 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:24.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803780 2026-02-13T05:57:24.856 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803780 2026-02-13T05:57:24.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803780' 2026-02-13T05:57:24.856 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:25.087 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803778 -lt 25769803780 2026-02-13T05:57:25.087 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:57:26.088 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:57:26.088 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:26.320 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803780 2026-02-13T05:57:26.320 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:26.320 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574852 2026-02-13T05:57:26.321 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:26.321 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:57:26.322 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574852 2026-02-13T05:57:26.322 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:26.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574852 2026-02-13T05:57:26.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574852' 2026-02-13T05:57:26.323 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 55834574852 2026-02-13T05:57:26.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:57:26.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-13T05:57:26.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:26.546 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378627 2026-02-13T05:57:26.546 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:26.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:57:26.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378627 2026-02-13T05:57:26.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:26.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378627 2026-02-13T05:57:26.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378627' 2026-02-13T05:57:26.549 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 81604378627 2026-02-13T05:57:26.549 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:57:26.771 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378628 -lt 81604378627 2026-02-13T05:57:26.771 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:26.771 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149700 2026-02-13T05:57:26.771 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:26.772 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:57:26.773 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149700 2026-02-13T05:57:26.773 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:26.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149700 2026-02-13T05:57:26.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149700' 2026-02-13T05:57:26.775 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 111669149700 2026-02-13T05:57:26.775 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:57:26.997 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149700 -lt 111669149700 2026-02-13T05:57:26.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:57:26.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:26.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:27.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:57:27.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:57:27.305 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:57:27.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:57:27.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:57:27.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:57:27.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:57:27.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:57:27.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:57:27.532 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:57:27.533 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:27.533 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:27.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:57:27.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:57:27.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:57:27.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:328: TEST_rados_get_bad_size_shard_0: local shard_id=0 2026-02-13T05:57:27.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:329: TEST_rados_get_bad_size_shard_0: rados_get_data_bad_size td/test-erasure-eio 0 10 2026-02-13T05:57:27.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-13T05:57:27.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:233: rados_get_data_bad_size: shift 2026-02-13T05:57:27.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:234: rados_get_data_bad_size: local shard_id=0 2026-02-13T05:57:27.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:235: rados_get_data_bad_size: shift 2026-02-13T05:57:27.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: local bytes=10 2026-02-13T05:57:27.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:237: rados_get_data_bad_size: shift 2026-02-13T05:57:27.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: local mode=set 2026-02-13T05:57:27.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:240: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-13T05:57:27.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: local objname=obj-size-72120-0-10 2026-02-13T05:57:27.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-72120-0-10 2026-02-13T05:57:27.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:57:27.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:57:27.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-72120-0-10 2026-02-13T05:57:27.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:27.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:57:27.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:27.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:57:27.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:27.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:57:27.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:27.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:57:27.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-72120-0-10 td/test-erasure-eio/ORIGINAL 2026-02-13T05:57:27.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:246: rados_get_data_bad_size: set_size obj-size-72120-0-10 td/test-erasure-eio 0 10 set 2026-02-13T05:57:27.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72120-0-10 2026-02-13T05:57:27.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-13T05:57:27.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-13T05:57:27.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-13T05:57:27.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=0 2026-02-13T05:57:27.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-13T05:57:27.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=10 2026-02-13T05:57:27.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-13T05:57:27.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-13T05:57:27.866 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-13T05:57:27.866 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72120-0-10 2026-02-13T05:57:27.867 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:57:27.867 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72120-0-10 2026-02-13T05:57:27.867 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72120-0-10 2026-02-13T05:57:27.867 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:57:28.093 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:57:28.093 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:28.093 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:57:28.093 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:57:28.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-13T05:57:28.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-13T05:57:28.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=3 2026-02-13T05:57:28.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-13T05:57:28.377 INFO:tasks.workunit.client.0.trial024.stderr:noout is set 2026-02-13T05:57:28.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-13T05:57:28.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 10 = 0 ']' 2026-02-13T05:57:28.386 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: set_size: dd if=/dev/urandom bs=10 count=1 of=td/test-erasure-eio/CORRUPT 2026-02-13T05:57:28.388 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records in 2026-02-13T05:57:28.388 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records out 2026-02-13T05:57:28.388 INFO:tasks.workunit.client.0.trial024.stderr:10 bytes copied, 3.6578e-05 s, 273 kB/s 2026-02-13T05:57:28.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 3 obj-size-72120-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:28.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:57:28.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:57:28.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-13T05:57:28.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:57:28.388 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 3 obj-size-72120-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:28.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:57:28.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:57:28.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-13T05:57:28.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:57:28.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-13T05:57:28.389 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:57:28.389 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:57:28.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:57:28.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:57:28.389 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:57:28.694 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:57:28.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 3 obj-size-72120-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:28.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:57:28.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:57:28.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-13T05:57:28.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:57:28.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/3 2026-02-13T05:57:28.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/3 obj-size-72120-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:28.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 3 2026-02-13T05:57:28.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:57:28.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:57:28.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-13T05:57:28.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:57:28.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:57:28.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:57:28.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:57:28.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:57:28.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:57:28.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:57:28.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:57:28.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:57:28.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:57:28.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:57:28.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:57:28.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:57:28.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:57:28.849 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:57:28.849 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:28.849 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:28.849 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:28.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:28.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:57:28.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:57:28.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:57:28.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:57:28.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:57:28.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:57:28.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:57:28.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:57:28.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:57:28.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:57:28.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-13T05:57:28.850 INFO:tasks.workunit.client.0.trial024.stderr:start osd.3 2026-02-13T05:57:28.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:57:28.851 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-13T05:57:28.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-13T05:57:28.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:57:28.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:57:28.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:57:28.864 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:28.862+0000 7f9b27346900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:28.865 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:28.863+0000 7f9b27346900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:28.866 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:28.864+0000 7f9b27346900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:28.998 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:28.997+0000 7f9b27346900 -1 Falling back to public interface 2026-02-13T05:57:29.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-13T05:57:29.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:57:29.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:57:29.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:57:29.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:57:29.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:29.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:57:29.074 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:57:29.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:29.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:57:29.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:57:29.322 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:29.320+0000 7f9b27346900 -1 osd.3 35 log_to_monitors true 2026-02-13T05:57:30.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:57:30.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:30.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:57:30.301 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:30.302 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:30.302 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:57:30.522 INFO:tasks.workunit.client.0.trial024.stderr:osd.3 up in weight 1 up_from 40 up_thru 40 down_at 37 last_clean_interval [26,35) [v2:127.0.0.1:6826/3661509209,v1:127.0.0.1:6827/3661509209] [v2:127.0.0.1:6828/3661509209,v1:127.0.0.1:6829/3661509209] exists,up 83d51774-3260-4495-bb24-73733db8e2b9 2026-02-13T05:57:30.522 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:57:30.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:57:30.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:57:30.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:57:30.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:57:30.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:57:30.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:57:30.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:57:30.523 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:57:30.523 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:57:30.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:57:30.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:57:30.523 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:57:30.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:57:30.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:57:30.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:57:30.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:57:30.608 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:57:30.608 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:57:30.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:57:30.832 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:30.832 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:57:30.832 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:57:30.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:57:30.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:30.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:57:30.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803784 2026-02-13T05:57:30.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803784 2026-02-13T05:57:30.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784' 2026-02-13T05:57:30.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:30.897 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:57:30.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574855 2026-02-13T05:57:30.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574855 2026-02-13T05:57:30.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-55834574855' 2026-02-13T05:57:30.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:30.963 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:57:31.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378631 2026-02-13T05:57:31.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378631 2026-02-13T05:57:31.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-55834574855 2-81604378631' 2026-02-13T05:57:31.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:31.025 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:57:31.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691843 2026-02-13T05:57:31.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691843 2026-02-13T05:57:31.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-55834574855 2-81604378631 3-171798691843' 2026-02-13T05:57:31.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:31.091 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803784 2026-02-13T05:57:31.091 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:31.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:57:31.092 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803784 2026-02-13T05:57:31.092 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:31.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803784 2026-02-13T05:57:31.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803784' 2026-02-13T05:57:31.093 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803784 2026-02-13T05:57:31.094 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:31.315 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803784 2026-02-13T05:57:31.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:57:32.316 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:57:32.317 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:32.544 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803784 -lt 25769803784 2026-02-13T05:57:32.544 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:32.545 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574855 2026-02-13T05:57:32.545 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:32.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:57:32.546 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574855 2026-02-13T05:57:32.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:32.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574855 2026-02-13T05:57:32.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574855' 2026-02-13T05:57:32.548 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 55834574855 2026-02-13T05:57:32.548 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:57:32.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574855 -lt 55834574855 2026-02-13T05:57:32.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:32.779 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378631 2026-02-13T05:57:32.779 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:32.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:57:32.780 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378631 2026-02-13T05:57:32.780 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:32.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378631 2026-02-13T05:57:32.782 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378631' 2026-02-13T05:57:32.782 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 81604378631 2026-02-13T05:57:32.782 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:57:33.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378631 -lt 81604378631 2026-02-13T05:57:33.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:33.005 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-171798691843 2026-02-13T05:57:33.005 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:33.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:57:33.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-171798691843 2026-02-13T05:57:33.007 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:33.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=171798691843 2026-02-13T05:57:33.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 171798691843' 2026-02-13T05:57:33.008 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 171798691843 2026-02-13T05:57:33.008 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:57:33.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 171798691843 -lt 171798691843 2026-02-13T05:57:33.230 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:57:33.231 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:33.231 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:33.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:57:33.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:57:33.544 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:57:33.544 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:57:33.544 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:57:33.544 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:57:33.544 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:57:33.544 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:57:33.763 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:57:33.764 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:57:33.764 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:33.764 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:34.070 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:57:34.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:57:34.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:57:34.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-13T05:57:34.071 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-13T05:57:34.388 INFO:tasks.workunit.client.0.trial024.stderr:noout is unset 2026-02-13T05:57:34.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:248: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72120-0-10 2026-02-13T05:57:34.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:57:34.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:57:34.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72120-0-10 2026-02-13T05:57:34.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:57:34.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:57:34.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72120-0-10 td/test-erasure-eio/COPY 2026-02-13T05:57:34.418 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:57:34.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:57:34.420 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: expr 0 + 1 2026-02-13T05:57:34.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: local another_shard_id=1 2026-02-13T05:57:34.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:252: rados_get_data_bad_size: set_size obj-size-72120-0-10 td/test-erasure-eio 1 10 set 2026-02-13T05:57:34.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72120-0-10 2026-02-13T05:57:34.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-13T05:57:34.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-13T05:57:34.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-13T05:57:34.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=1 2026-02-13T05:57:34.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-13T05:57:34.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=10 2026-02-13T05:57:34.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-13T05:57:34.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-13T05:57:34.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-13T05:57:34.424 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72120-0-10 2026-02-13T05:57:34.424 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:57:34.424 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72120-0-10 2026-02-13T05:57:34.424 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72120-0-10 2026-02-13T05:57:34.424 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:57:34.650 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:57:34.650 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:34.650 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:57:34.650 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:57:34.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-13T05:57:34.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-13T05:57:34.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=1 2026-02-13T05:57:34.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-13T05:57:34.963 INFO:tasks.workunit.client.0.trial024.stderr:noout is set 2026-02-13T05:57:34.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-13T05:57:34.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 10 = 0 ']' 2026-02-13T05:57:34.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: set_size: dd if=/dev/urandom bs=10 count=1 of=td/test-erasure-eio/CORRUPT 2026-02-13T05:57:34.976 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records in 2026-02-13T05:57:34.976 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records out 2026-02-13T05:57:34.977 INFO:tasks.workunit.client.0.trial024.stderr:10 bytes copied, 4.6737e-05 s, 214 kB/s 2026-02-13T05:57:34.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72120-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:34.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:57:34.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:57:34.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-13T05:57:34.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:57:34.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72120-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:34.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:57:34.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:57:34.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-13T05:57:34.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:57:34.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-13T05:57:34.978 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:57:34.978 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:57:34.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:57:34.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:57:34.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:57:35.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:57:35.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72120-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:35.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:57:35.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:57:35.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T05:57:35.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:57:35.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-13T05:57:35.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72120-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:35.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-13T05:57:35.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:57:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:57:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T05:57:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:57:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:57:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:57:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:57:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:57:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:57:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:57:35.446 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:57:35.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:57:35.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:57:35.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:57:35.447 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:57:35.447 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:57:35.447 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:57:35.447 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:57:35.447 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:35.447 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:35.447 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:35.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:35.447 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:57:35.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:57:35.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:57:35.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:57:35.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:57:35.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:57:35.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:57:35.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:57:35.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:57:35.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:57:35.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T05:57:35.448 INFO:tasks.workunit.client.0.trial024.stderr:start osd.1 2026-02-13T05:57:35.448 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:57:35.449 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-13T05:57:35.449 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T05:57:35.449 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:57:35.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:57:35.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:57:35.461 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:35.459+0000 7f07706d2900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:35.462 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:35.461+0000 7f07706d2900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:35.463 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:35.462+0000 7f07706d2900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:35.615 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:35.613+0000 7f07706d2900 -1 Falling back to public interface 2026-02-13T05:57:35.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T05:57:35.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:57:35.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:57:35.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:57:35.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:57:35.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:35.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:57:35.681 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:57:35.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:35.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:57:35.906 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:57:36.004 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:36.002+0000 7f07706d2900 -1 osd.1 43 log_to_monitors true 2026-02-13T05:57:36.908 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:57:36.908 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:36.908 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:57:36.908 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:36.908 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:36.909 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:57:37.135 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 46 last_clean_interval [13,43) [v2:127.0.0.1:6810/1487181950,v1:127.0.0.1:6811/1487181950] [v2:127.0.0.1:6812/1487181950,v1:127.0.0.1:6813/1487181950] exists,up dc0d2834-1486-4fda-a8bc-0945f2d718fb 2026-02-13T05:57:37.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:57:37.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:57:37.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:57:37.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:57:37.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:57:37.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:57:37.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:57:37.136 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:57:37.136 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:57:37.136 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:57:37.136 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:57:37.136 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:57:37.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:57:37.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:57:37.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:57:37.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:57:37.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:57:37.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:57:37.222 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:57:37.443 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:57:37.443 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:37.443 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:57:37.443 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:57:37.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:57:37.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:37.444 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:57:37.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803787 2026-02-13T05:57:37.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803787 2026-02-13T05:57:37.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787' 2026-02-13T05:57:37.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:37.508 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:57:37.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397507 2026-02-13T05:57:37.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397507 2026-02-13T05:57:37.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787 1-210453397507' 2026-02-13T05:57:37.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:37.573 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:57:37.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378634 2026-02-13T05:57:37.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378634 2026-02-13T05:57:37.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787 1-210453397507 2-81604378634' 2026-02-13T05:57:37.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:37.638 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:57:37.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691846 2026-02-13T05:57:37.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691846 2026-02-13T05:57:37.703 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787 1-210453397507 2-81604378634 3-171798691846' 2026-02-13T05:57:37.703 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:37.703 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803787 2026-02-13T05:57:37.703 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:37.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:57:37.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803787 2026-02-13T05:57:37.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:37.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803787 2026-02-13T05:57:37.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803787' 2026-02-13T05:57:37.706 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803787 2026-02-13T05:57:37.706 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:37.929 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803787 -lt 25769803787 2026-02-13T05:57:37.929 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:37.929 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-210453397507 2026-02-13T05:57:37.930 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:37.930 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:57:37.931 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-210453397507 2026-02-13T05:57:37.931 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:37.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=210453397507 2026-02-13T05:57:37.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 210453397507' 2026-02-13T05:57:37.932 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 210453397507 2026-02-13T05:57:37.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:57:38.156 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 210453397507 -lt 210453397507 2026-02-13T05:57:38.156 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:38.157 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378634 2026-02-13T05:57:38.157 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:38.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:57:38.159 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378634 2026-02-13T05:57:38.159 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:38.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378634 2026-02-13T05:57:38.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378634' 2026-02-13T05:57:38.160 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 81604378634 2026-02-13T05:57:38.160 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:57:38.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378632 -lt 81604378634 2026-02-13T05:57:38.383 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:57:39.384 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:57:39.385 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:57:39.617 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378632 -lt 81604378634 2026-02-13T05:57:39.617 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:57:40.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T05:57:40.619 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:57:40.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378634 -lt 81604378634 2026-02-13T05:57:40.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:40.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-171798691846 2026-02-13T05:57:40.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:40.849 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:57:40.850 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-171798691846 2026-02-13T05:57:40.850 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:40.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=171798691846 2026-02-13T05:57:40.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 171798691846' 2026-02-13T05:57:40.851 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 171798691846 2026-02-13T05:57:40.851 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:57:41.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 171798691847 -lt 171798691846 2026-02-13T05:57:41.076 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:57:41.077 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:41.077 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:41.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:57:41.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:57:41.386 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:57:41.386 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:57:41.386 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:57:41.386 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:57:41.387 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:57:41.387 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:57:41.610 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:57:41.611 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:57:41.611 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:41.612 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:41.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:57:41.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:57:41.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:57:41.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-13T05:57:41.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-13T05:57:42.252 INFO:tasks.workunit.client.0.trial024.stderr:noout is unset 2026-02-13T05:57:42.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:253: rados_get_data_bad_size: '[' 0 -eq 1 -a 1 -eq 2 ']' 2026-02-13T05:57:42.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:262: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72120-0-10 fail 2026-02-13T05:57:42.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:57:42.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:57:42.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72120-0-10 2026-02-13T05:57:42.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-13T05:57:42.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-13T05:57:42.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-size-72120-0-10 td/test-erasure-eio/COPY 2026-02-13T05:57:42.281 INFO:tasks.workunit.client.0.trial024.stderr:error getting pool-jerasure/obj-size-72120-0-10: (5) Input/output error 2026-02-13T05:57:42.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-13T05:57:42.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:264: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-13T05:57:42.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:330: TEST_rados_get_bad_size_shard_0: rados_get_data_bad_size td/test-erasure-eio 0 0 2026-02-13T05:57:42.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-13T05:57:42.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:233: rados_get_data_bad_size: shift 2026-02-13T05:57:42.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:234: rados_get_data_bad_size: local shard_id=0 2026-02-13T05:57:42.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:235: rados_get_data_bad_size: shift 2026-02-13T05:57:42.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: local bytes=0 2026-02-13T05:57:42.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:237: rados_get_data_bad_size: shift 2026-02-13T05:57:42.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: local mode=set 2026-02-13T05:57:42.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:240: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-13T05:57:42.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: local objname=obj-size-72120-0-0 2026-02-13T05:57:42.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-72120-0-0 2026-02-13T05:57:42.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:57:42.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:57:42.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-72120-0-0 2026-02-13T05:57:42.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:42.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:57:42.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:42.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:57:42.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:42.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:57:42.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:42.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:57:42.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-72120-0-0 td/test-erasure-eio/ORIGINAL 2026-02-13T05:57:42.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:246: rados_get_data_bad_size: set_size obj-size-72120-0-0 td/test-erasure-eio 0 0 set 2026-02-13T05:57:42.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72120-0-0 2026-02-13T05:57:42.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-13T05:57:42.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-13T05:57:42.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-13T05:57:42.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=0 2026-02-13T05:57:42.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-13T05:57:42.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=0 2026-02-13T05:57:42.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-13T05:57:42.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-13T05:57:42.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-13T05:57:42.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72120-0-0 2026-02-13T05:57:42.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:57:42.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72120-0-0 2026-02-13T05:57:42.306 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72120-0-0 2026-02-13T05:57:42.306 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:57:42.529 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:57:42.529 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:42.530 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:57:42.530 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:57:42.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-13T05:57:42.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-13T05:57:42.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=3 2026-02-13T05:57:42.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-13T05:57:42.813 INFO:tasks.workunit.client.0.trial024.stderr:noout is set 2026-02-13T05:57:42.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-13T05:57:42.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 0 = 0 ']' 2026-02-13T05:57:42.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: set_size: touch td/test-erasure-eio/CORRUPT 2026-02-13T05:57:42.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 3 obj-size-72120-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:42.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:57:42.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:57:42.827 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-13T05:57:42.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:57:42.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 3 obj-size-72120-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:42.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:57:42.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:57:42.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-13T05:57:42.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:57:42.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-13T05:57:42.828 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:57:42.828 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:57:42.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:57:42.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:57:42.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:57:43.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:57:43.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 3 obj-size-72120-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:43.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:57:43.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:57:43.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-13T05:57:43.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:57:43.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/3 2026-02-13T05:57:43.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/3 obj-size-72120-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:43.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 3 2026-02-13T05:57:43.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:57:43.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:57:43.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-13T05:57:43.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:57:43.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:57:43.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:57:43.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:57:43.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:57:43.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:57:43.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:57:43.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:57:43.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:57:43.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:57:43.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:57:43.278 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:57:43.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:57:43.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:57:43.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:57:43.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:57:43.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:57:43.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-13T05:57:43.280 INFO:tasks.workunit.client.0.trial024.stderr:start osd.3 2026-02-13T05:57:43.280 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:57:43.280 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-13T05:57:43.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-13T05:57:43.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:57:43.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:57:43.281 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:57:43.294 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:43.293+0000 7ff1925f4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:43.295 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:43.295+0000 7ff1925f4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:43.296 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:43.296+0000 7ff1925f4900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:43.485 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:43.485+0000 7ff1925f4900 -1 Falling back to public interface 2026-02-13T05:57:43.499 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-13T05:57:43.499 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:57:43.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:57:43.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:57:43.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:57:43.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:43.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:57:43.500 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:57:43.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:43.500 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:57:43.722 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:57:43.829 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:43.829+0000 7ff1925f4900 -1 osd.3 54 log_to_monitors true 2026-02-13T05:57:44.724 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:57:44.724 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:44.724 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:57:44.725 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:44.725 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:44.725 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:57:44.950 INFO:tasks.workunit.client.0.trial024.stderr:osd.3 up in weight 1 up_from 58 up_thru 58 down_at 55 last_clean_interval [40,54) [v2:127.0.0.1:6826/1356268982,v1:127.0.0.1:6827/1356268982] [v2:127.0.0.1:6828/1356268982,v1:127.0.0.1:6829/1356268982] exists,up 83d51774-3260-4495-bb24-73733db8e2b9 2026-02-13T05:57:44.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:57:44.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:57:44.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:57:44.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:57:44.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:57:44.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:57:44.951 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:57:44.951 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:57:44.951 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:57:44.952 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:57:44.952 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:57:44.952 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:57:44.952 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:57:45.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:57:45.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:57:45.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:57:45.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:57:45.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:57:45.037 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:57:45.259 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:57:45.259 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:45.260 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:57:45.260 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:57:45.260 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:57:45.260 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:45.260 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:57:45.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803791 2026-02-13T05:57:45.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803791 2026-02-13T05:57:45.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791' 2026-02-13T05:57:45.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:45.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:57:45.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397510 2026-02-13T05:57:45.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397510 2026-02-13T05:57:45.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-210453397510' 2026-02-13T05:57:45.387 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:45.388 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:57:45.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378638 2026-02-13T05:57:45.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378638 2026-02-13T05:57:45.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-210453397510 2-81604378638' 2026-02-13T05:57:45.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:45.450 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:57:45.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103171 2026-02-13T05:57:45.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103171 2026-02-13T05:57:45.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-210453397510 2-81604378638 3-249108103171' 2026-02-13T05:57:45.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:45.516 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803791 2026-02-13T05:57:45.516 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:45.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:57:45.517 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803791 2026-02-13T05:57:45.518 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:45.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803791 2026-02-13T05:57:45.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803791' 2026-02-13T05:57:45.519 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803791 2026-02-13T05:57:45.519 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:45.740 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803791 -lt 25769803791 2026-02-13T05:57:45.741 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:45.741 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-210453397510 2026-02-13T05:57:45.741 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:45.742 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:57:45.743 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-210453397510 2026-02-13T05:57:45.743 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:45.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=210453397510 2026-02-13T05:57:45.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 210453397510' 2026-02-13T05:57:45.744 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 210453397510 2026-02-13T05:57:45.745 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:57:45.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 210453397510 -lt 210453397510 2026-02-13T05:57:45.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:45.973 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378638 2026-02-13T05:57:45.973 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:45.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:57:45.974 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378638 2026-02-13T05:57:45.974 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:45.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378638 2026-02-13T05:57:45.976 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378638' 2026-02-13T05:57:45.976 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 81604378638 2026-02-13T05:57:45.976 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:57:46.199 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378638 -lt 81604378638 2026-02-13T05:57:46.199 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:46.199 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-249108103171 2026-02-13T05:57:46.200 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:46.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:57:46.201 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-249108103171 2026-02-13T05:57:46.202 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:46.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=249108103171 2026-02-13T05:57:46.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 249108103171' 2026-02-13T05:57:46.203 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 249108103171 2026-02-13T05:57:46.203 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:57:46.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 249108103171 -lt 249108103171 2026-02-13T05:57:46.427 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:57:46.427 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:46.427 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:46.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:57:46.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:57:46.745 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:57:46.745 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:57:46.745 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:57:46.745 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:57:46.745 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:57:46.745 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:57:46.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:57:46.967 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:57:46.967 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:46.967 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:47.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:57:47.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:57:47.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:57:47.278 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-13T05:57:47.279 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-13T05:57:47.593 INFO:tasks.workunit.client.0.trial024.stderr:noout is unset 2026-02-13T05:57:47.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:248: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72120-0-0 2026-02-13T05:57:47.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:57:47.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:57:47.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72120-0-0 2026-02-13T05:57:47.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:57:47.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:57:47.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72120-0-0 td/test-erasure-eio/COPY 2026-02-13T05:57:47.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:57:47.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:57:47.626 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: expr 0 + 1 2026-02-13T05:57:47.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: local another_shard_id=1 2026-02-13T05:57:47.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:252: rados_get_data_bad_size: set_size obj-size-72120-0-0 td/test-erasure-eio 1 0 set 2026-02-13T05:57:47.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72120-0-0 2026-02-13T05:57:47.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-13T05:57:47.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-13T05:57:47.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-13T05:57:47.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=1 2026-02-13T05:57:47.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-13T05:57:47.628 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=0 2026-02-13T05:57:47.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-13T05:57:47.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-13T05:57:47.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-13T05:57:47.629 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72120-0-0 2026-02-13T05:57:47.629 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:57:47.629 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72120-0-0 2026-02-13T05:57:47.629 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72120-0-0 2026-02-13T05:57:47.629 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:57:47.856 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:57:47.856 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:47.856 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:57:47.856 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:57:47.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-13T05:57:47.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-13T05:57:47.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=1 2026-02-13T05:57:47.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-13T05:57:48.175 INFO:tasks.workunit.client.0.trial024.stderr:noout is set 2026-02-13T05:57:48.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-13T05:57:48.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 0 = 0 ']' 2026-02-13T05:57:48.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: set_size: touch td/test-erasure-eio/CORRUPT 2026-02-13T05:57:48.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72120-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:48.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:57:48.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:57:48.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-13T05:57:48.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:57:48.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72120-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:48.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:57:48.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:57:48.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-13T05:57:48.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:57:48.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-13T05:57:48.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:57:48.186 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:57:48.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:57:48.186 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:57:48.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:57:48.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:57:48.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72120-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:48.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:57:48.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:57:48.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T05:57:48.493 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:57:48.493 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-13T05:57:48.493 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72120-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:48.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-13T05:57:48.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:57:48.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:57:48.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T05:57:48.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:57:48.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:57:48.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:57:48.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:57:48.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:57:48.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:57:48.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:57:48.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:57:48.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:57:48.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:57:48.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:57:48.638 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:57:48.638 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:57:48.638 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:57:48.638 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:57:48.638 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:48.639 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:48.639 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:48.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:48.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:57:48.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:57:48.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:57:48.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:57:48.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:57:48.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:57:48.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:57:48.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:57:48.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:57:48.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:57:48.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T05:57:48.640 INFO:tasks.workunit.client.0.trial024.stderr:start osd.1 2026-02-13T05:57:48.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:57:48.640 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-13T05:57:48.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T05:57:48.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:57:48.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:57:48.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:57:48.653 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:48.652+0000 7ff047e0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:48.654 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:48.653+0000 7ff047e0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:48.655 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:48.655+0000 7ff047e0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:48.783 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:48.782+0000 7ff047e0c900 -1 Falling back to public interface 2026-02-13T05:57:48.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T05:57:48.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:57:48.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:57:48.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:57:48.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:57:48.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:48.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:57:48.862 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:57:48.863 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:48.863 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:57:49.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:57:49.129 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:49.128+0000 7ff047e0c900 -1 osd.1 62 log_to_monitors true 2026-02-13T05:57:50.086 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:57:50.087 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:50.087 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:57:50.087 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:50.087 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:50.087 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:57:50.311 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 up in weight 1 up_from 68 up_thru 68 down_at 65 last_clean_interval [49,62) [v2:127.0.0.1:6810/2848343043,v1:127.0.0.1:6811/2848343043] [v2:127.0.0.1:6812/2848343043,v1:127.0.0.1:6813/2848343043] exists,up dc0d2834-1486-4fda-a8bc-0945f2d718fb 2026-02-13T05:57:50.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:57:50.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:57:50.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:57:50.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:57:50.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:57:50.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:57:50.311 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:57:50.311 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:57:50.312 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:57:50.312 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:57:50.312 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:57:50.313 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:57:50.313 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:57:50.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:57:50.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:57:50.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:57:50.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:57:50.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:57:50.398 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:57:50.622 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:57:50.622 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:50.623 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:57:50.623 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:57:50.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:57:50.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:50.623 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:57:50.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803794 2026-02-13T05:57:50.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803794 2026-02-13T05:57:50.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803794' 2026-02-13T05:57:50.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:50.689 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:57:50.756 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776131 2026-02-13T05:57:50.757 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776131 2026-02-13T05:57:50.757 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803794 1-292057776131' 2026-02-13T05:57:50.757 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:50.757 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:57:50.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378641 2026-02-13T05:57:50.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378641 2026-02-13T05:57:50.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803794 1-292057776131 2-81604378641' 2026-02-13T05:57:50.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:50.819 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:57:50.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103174 2026-02-13T05:57:50.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103174 2026-02-13T05:57:50.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803794 1-292057776131 2-81604378641 3-249108103174' 2026-02-13T05:57:50.883 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:50.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803794 2026-02-13T05:57:50.884 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:50.884 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:57:50.885 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803794 2026-02-13T05:57:50.885 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:50.886 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803794 2026-02-13T05:57:50.886 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803794' 2026-02-13T05:57:50.886 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803794 2026-02-13T05:57:50.886 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:51.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803791 -lt 25769803794 2026-02-13T05:57:51.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:57:52.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:57:52.112 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:52.349 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803794 -lt 25769803794 2026-02-13T05:57:52.349 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:52.350 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-292057776131 2026-02-13T05:57:52.350 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:52.350 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:57:52.351 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:52.351 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-292057776131 2026-02-13T05:57:52.352 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=292057776131 2026-02-13T05:57:52.352 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 292057776131' 2026-02-13T05:57:52.353 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 292057776131 2026-02-13T05:57:52.353 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:57:52.575 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 292057776131 -lt 292057776131 2026-02-13T05:57:52.575 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:52.576 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378641 2026-02-13T05:57:52.576 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:52.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:57:52.578 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378641 2026-02-13T05:57:52.578 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:52.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378641 2026-02-13T05:57:52.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378641' 2026-02-13T05:57:52.579 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 81604378641 2026-02-13T05:57:52.579 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:57:52.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378641 -lt 81604378641 2026-02-13T05:57:52.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:52.803 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-249108103174 2026-02-13T05:57:52.803 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:52.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:57:52.804 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-249108103174 2026-02-13T05:57:52.804 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:52.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=249108103174 2026-02-13T05:57:52.806 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 249108103174' 2026-02-13T05:57:52.806 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 249108103174 2026-02-13T05:57:52.806 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:57:53.029 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 249108103174 -lt 249108103174 2026-02-13T05:57:53.029 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:57:53.029 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:53.030 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:53.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:57:53.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:57:53.339 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:57:53.339 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:57:53.339 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:57:53.339 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:57:53.339 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:57:53.339 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:57:53.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:57:53.562 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:57:53.563 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:53.563 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:53.875 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:57:53.875 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:57:53.875 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:57:53.875 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-13T05:57:53.875 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-13T05:57:54.188 INFO:tasks.workunit.client.0.trial024.stderr:noout is unset 2026-02-13T05:57:54.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:253: rados_get_data_bad_size: '[' 0 -eq 1 -a 1 -eq 2 ']' 2026-02-13T05:57:54.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:262: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72120-0-0 fail 2026-02-13T05:57:54.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:57:54.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:57:54.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72120-0-0 2026-02-13T05:57:54.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-13T05:57:54.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-13T05:57:54.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-size-72120-0-0 td/test-erasure-eio/COPY 2026-02-13T05:57:54.216 INFO:tasks.workunit.client.0.trial024.stderr:error getting pool-jerasure/obj-size-72120-0-0: (5) Input/output error 2026-02-13T05:57:54.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-13T05:57:54.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:264: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-13T05:57:54.220 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:331: TEST_rados_get_bad_size_shard_0: rados_get_data_bad_size td/test-erasure-eio 0 256 add 2026-02-13T05:57:54.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-13T05:57:54.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:233: rados_get_data_bad_size: shift 2026-02-13T05:57:54.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:234: rados_get_data_bad_size: local shard_id=0 2026-02-13T05:57:54.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:235: rados_get_data_bad_size: shift 2026-02-13T05:57:54.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: local bytes=256 2026-02-13T05:57:54.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:237: rados_get_data_bad_size: shift 2026-02-13T05:57:54.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: local mode=add 2026-02-13T05:57:54.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:240: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-13T05:57:54.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: local objname=obj-size-72120-0-256 2026-02-13T05:57:54.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-72120-0-256 2026-02-13T05:57:54.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:57:54.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:57:54.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-72120-0-256 2026-02-13T05:57:54.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:54.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:57:54.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:54.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:57:54.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:54.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:57:54.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:57:54.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:57:54.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-72120-0-256 td/test-erasure-eio/ORIGINAL 2026-02-13T05:57:54.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:246: rados_get_data_bad_size: set_size obj-size-72120-0-256 td/test-erasure-eio 0 256 add 2026-02-13T05:57:54.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72120-0-256 2026-02-13T05:57:54.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-13T05:57:54.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-13T05:57:54.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-13T05:57:54.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=0 2026-02-13T05:57:54.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-13T05:57:54.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=256 2026-02-13T05:57:54.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-13T05:57:54.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=add 2026-02-13T05:57:54.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-13T05:57:54.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72120-0-256 2026-02-13T05:57:54.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:57:54.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72120-0-256 2026-02-13T05:57:54.240 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72120-0-256 2026-02-13T05:57:54.240 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:57:54.469 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:57:54.469 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:54.469 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:57:54.469 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:57:54.469 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-13T05:57:54.469 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-13T05:57:54.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=3 2026-02-13T05:57:54.470 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-13T05:57:54.751 INFO:tasks.workunit.client.0.trial024.stderr:noout is set 2026-02-13T05:57:54.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' add = add ']' 2026-02-13T05:57:54.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: objectstore_tool td/test-erasure-eio 3 obj-size-72120-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:54.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:57:54.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:57:54.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-13T05:57:54.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:57:54.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 3 obj-size-72120-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:54.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:57:54.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:57:54.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-13T05:57:54.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:57:54.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-13T05:57:54.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:57:54.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:57:54.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:57:54.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:57:54.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:57:55.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:57:55.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 3 obj-size-72120-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:55.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:57:55.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:57:55.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-13T05:57:55.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:57:55.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/3 2026-02-13T05:57:55.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/3 obj-size-72120-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:57:55.149 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 3 2026-02-13T05:57:55.149 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:57:55.149 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:57:55.149 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-13T05:57:55.149 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:57:55.149 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:57:55.149 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:57:55.149 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:57:55.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:57:55.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:57:55.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:57:55.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:57:55.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:57:55.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:57:55.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:57:55.150 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:57:55.150 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:57:55.150 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:57:55.150 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:57:55.150 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:57:55.151 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:57:55.151 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:55.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:57:55.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:57:55.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:57:55.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:57:55.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:57:55.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:57:55.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:57:55.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:57:55.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:57:55.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:57:55.152 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:57:55.152 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-13T05:57:55.152 INFO:tasks.workunit.client.0.trial024.stderr:start osd.3 2026-02-13T05:57:55.152 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:57:55.152 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-13T05:57:55.153 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-13T05:57:55.153 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:57:55.153 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:57:55.153 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:57:55.165 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:55.164+0000 7f475d964900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:55.166 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:55.166+0000 7f475d964900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:55.167 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:55.167+0000 7f475d964900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:57:55.327 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:55.326+0000 7f475d964900 -1 Falling back to public interface 2026-02-13T05:57:55.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-13T05:57:55.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:57:55.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:57:55.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:57:55.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:57:55.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:55.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:57:55.378 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:57:55.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:55.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:57:55.602 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:57:55.648 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:57:55.647+0000 7f475d964900 -1 osd.3 71 log_to_monitors true 2026-02-13T05:57:56.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:57:56.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:57:56.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:57:56.604 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:56.604 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:57:56.604 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:57:56.830 INFO:tasks.workunit.client.0.trial024.stderr:osd.3 up in weight 1 up_from 77 up_thru 77 down_at 74 last_clean_interval [58,71) [v2:127.0.0.1:6826/18468894,v1:127.0.0.1:6827/18468894] [v2:127.0.0.1:6828/18468894,v1:127.0.0.1:6829/18468894] exists,up 83d51774-3260-4495-bb24-73733db8e2b9 2026-02-13T05:57:56.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:57:56.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:57:56.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:57:56.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:57:56.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:57:56.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:57:56.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:57:56.831 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:57:56.832 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:57:56.832 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:57:56.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:57:56.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:57:56.833 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:57:56.918 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:57:56.918 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:57:56.918 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:57:56.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:57:56.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:57:56.919 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:57:57.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:57:57.140 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:57:57.140 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:57:57.140 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:57:57.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:57:57.140 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:57.140 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:57:57.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803797 2026-02-13T05:57:57.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803797 2026-02-13T05:57:57.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803797' 2026-02-13T05:57:57.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:57.205 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:57:57.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776134 2026-02-13T05:57:57.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776134 2026-02-13T05:57:57.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803797 1-292057776134' 2026-02-13T05:57:57.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:57.270 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:57:57.334 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378644 2026-02-13T05:57:57.334 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378644 2026-02-13T05:57:57.334 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803797 1-292057776134 2-81604378644' 2026-02-13T05:57:57.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:57:57.335 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:57:57.398 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481795 2026-02-13T05:57:57.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481795 2026-02-13T05:57:57.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803797 1-292057776134 2-81604378644 3-330712481795' 2026-02-13T05:57:57.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:57.399 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803797 2026-02-13T05:57:57.399 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:57.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:57:57.401 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803797 2026-02-13T05:57:57.401 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:57.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803797 2026-02-13T05:57:57.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803797' 2026-02-13T05:57:57.402 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803797 2026-02-13T05:57:57.402 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:57.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803795 -lt 25769803797 2026-02-13T05:57:57.629 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:57:58.630 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:57:58.631 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:57:58.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803797 -lt 25769803797 2026-02-13T05:57:58.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:58.857 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-292057776134 2026-02-13T05:57:58.857 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:58.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:57:58.858 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-292057776134 2026-02-13T05:57:58.858 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:58.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=292057776134 2026-02-13T05:57:58.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 292057776134' 2026-02-13T05:57:58.860 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 292057776134 2026-02-13T05:57:58.860 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:57:59.086 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 292057776134 -lt 292057776134 2026-02-13T05:57:59.086 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:59.086 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378644 2026-02-13T05:57:59.087 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:59.087 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:57:59.088 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378644 2026-02-13T05:57:59.088 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:59.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378644 2026-02-13T05:57:59.089 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378644' 2026-02-13T05:57:59.089 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 81604378644 2026-02-13T05:57:59.090 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:57:59.315 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378644 -lt 81604378644 2026-02-13T05:57:59.315 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:57:59.316 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-330712481795 2026-02-13T05:57:59.316 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:57:59.317 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:57:59.318 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-330712481795 2026-02-13T05:57:59.318 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:57:59.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=330712481795 2026-02-13T05:57:59.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 330712481795' 2026-02-13T05:57:59.319 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 330712481795 2026-02-13T05:57:59.319 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:57:59.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 330712481795 -lt 330712481795 2026-02-13T05:57:59.542 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:57:59.542 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:57:59.542 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:57:59.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:57:59.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:57:59.856 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:57:59.856 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:57:59.856 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:57:59.856 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:57:59.856 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:57:59.856 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:58:00.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:58:00.078 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:58:00.079 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:00.079 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:00.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:58:00.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:58:00.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:58:00.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:219: set_size: dd if=/dev/urandom bs=256 count=1 2026-02-13T05:58:00.409 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records in 2026-02-13T05:58:00.409 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records out 2026-02-13T05:58:00.410 INFO:tasks.workunit.client.0.trial024.stderr:256 bytes copied, 2.0037e-05 s, 12.8 MB/s 2026-02-13T05:58:00.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 3 obj-size-72120-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:00.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:58:00.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:58:00.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-13T05:58:00.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:58:00.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 3 obj-size-72120-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:00.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:58:00.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:58:00.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-13T05:58:00.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:58:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-13T05:58:00.411 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:58:00.411 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:58:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:58:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:58:00.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:58:00.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:58:00.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 3 obj-size-72120-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:00.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:58:00.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:58:00.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-13T05:58:00.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:58:00.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/3 2026-02-13T05:58:00.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/3 obj-size-72120-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:00.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 3 2026-02-13T05:58:00.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:58:00.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:58:00.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-13T05:58:00.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:58:00.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:58:00.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:58:00.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:58:00.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:58:00.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:58:00.654 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:58:00.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:58:00.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:58:00.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:58:00.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:58:00.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:58:00.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:00.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:00.655 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:00.655 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:00.655 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:00.655 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:00.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:start osd.3 2026-02-13T05:58:00.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:58:00.657 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-13T05:58:00.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-13T05:58:00.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:58:00.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:58:00.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:58:00.670 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:00.670+0000 7f763f212900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:00.672 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:00.671+0000 7f763f212900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:00.672 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:00.672+0000 7f763f212900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:00.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-13T05:58:00.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:58:00.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:58:00.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:58:00.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:58:00.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:00.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:58:00.878 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:58:00.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:00.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:58:00.893 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:00.893+0000 7f763f212900 -1 Falling back to public interface 2026-02-13T05:58:01.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:58:01.228 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:01.227+0000 7f763f212900 -1 osd.3 79 log_to_monitors true 2026-02-13T05:58:02.101 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:58:02.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:02.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:58:02.102 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:02.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:02.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:58:02.328 INFO:tasks.workunit.client.0.trial024.stderr:osd.3 up in weight 1 up_from 83 up_thru 83 down_at 80 last_clean_interval [77,79) [v2:127.0.0.1:6826/2318819312,v1:127.0.0.1:6827/2318819312] [v2:127.0.0.1:6828/2318819312,v1:127.0.0.1:6829/2318819312] exists,up 83d51774-3260-4495-bb24-73733db8e2b9 2026-02-13T05:58:02.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:58:02.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:58:02.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:58:02.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:58:02.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:58:02.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:58:02.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:58:02.329 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:58:02.329 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:58:02.329 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:58:02.329 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:58:02.330 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:58:02.330 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:58:02.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:58:02.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:58:02.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:58:02.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:58:02.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:58:02.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:58:02.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:58:02.637 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:02.638 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:58:02.638 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:58:02.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:58:02.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:02.638 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:58:02.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803800 2026-02-13T05:58:02.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803800 2026-02-13T05:58:02.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803800' 2026-02-13T05:58:02.703 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:02.703 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:58:02.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776137 2026-02-13T05:58:02.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776137 2026-02-13T05:58:02.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803800 1-292057776137' 2026-02-13T05:58:02.767 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:02.767 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:58:02.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378647 2026-02-13T05:58:02.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378647 2026-02-13T05:58:02.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803800 1-292057776137 2-81604378647' 2026-02-13T05:58:02.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:02.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:58:02.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=356482285571 2026-02-13T05:58:02.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 356482285571 2026-02-13T05:58:02.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803800 1-292057776137 2-81604378647 3-356482285571' 2026-02-13T05:58:02.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:02.897 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803800 2026-02-13T05:58:02.898 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:02.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:58:02.899 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803800 2026-02-13T05:58:02.899 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:02.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803800 2026-02-13T05:58:02.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803800' 2026-02-13T05:58:02.900 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803800 2026-02-13T05:58:02.900 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:58:03.123 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803798 -lt 25769803800 2026-02-13T05:58:03.124 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:58:04.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:58:04.125 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:58:04.350 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803800 -lt 25769803800 2026-02-13T05:58:04.350 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:04.351 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-292057776137 2026-02-13T05:58:04.351 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:04.352 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:58:04.352 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-292057776137 2026-02-13T05:58:04.352 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:04.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=292057776137 2026-02-13T05:58:04.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 292057776137' 2026-02-13T05:58:04.354 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 292057776137 2026-02-13T05:58:04.354 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:58:04.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 292057776137 -lt 292057776137 2026-02-13T05:58:04.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:04.577 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378647 2026-02-13T05:58:04.577 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:04.578 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:58:04.579 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378647 2026-02-13T05:58:04.579 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:04.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378647 2026-02-13T05:58:04.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378647' 2026-02-13T05:58:04.580 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 81604378647 2026-02-13T05:58:04.581 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:58:04.808 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378647 -lt 81604378647 2026-02-13T05:58:04.808 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:04.809 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-356482285571 2026-02-13T05:58:04.809 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:04.809 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:58:04.810 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-356482285571 2026-02-13T05:58:04.810 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:04.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=356482285571 2026-02-13T05:58:04.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 356482285571' 2026-02-13T05:58:04.812 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 356482285571 2026-02-13T05:58:04.812 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:58:05.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 356482285571 -lt 356482285571 2026-02-13T05:58:05.039 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:58:05.040 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:05.040 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:05.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:58:05.346 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:58:05.347 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:58:05.347 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:58:05.348 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:58:05.348 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:58:05.348 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:58:05.348 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:58:05.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:58:05.569 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:58:05.569 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:05.569 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:05.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:58:05.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:58:05.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:58:05.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-13T05:58:05.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-13T05:58:06.213 INFO:tasks.workunit.client.0.trial024.stderr:noout is unset 2026-02-13T05:58:06.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:248: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72120-0-256 2026-02-13T05:58:06.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:58:06.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:58:06.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72120-0-256 2026-02-13T05:58:06.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:58:06.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:58:06.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72120-0-256 td/test-erasure-eio/COPY 2026-02-13T05:58:06.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:58:06.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:58:06.247 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: expr 0 + 1 2026-02-13T05:58:06.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: local another_shard_id=1 2026-02-13T05:58:06.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:252: rados_get_data_bad_size: set_size obj-size-72120-0-256 td/test-erasure-eio 1 256 add 2026-02-13T05:58:06.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72120-0-256 2026-02-13T05:58:06.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-13T05:58:06.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-13T05:58:06.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-13T05:58:06.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=1 2026-02-13T05:58:06.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-13T05:58:06.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=256 2026-02-13T05:58:06.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-13T05:58:06.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=add 2026-02-13T05:58:06.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-13T05:58:06.250 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72120-0-256 2026-02-13T05:58:06.251 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:58:06.251 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72120-0-256 2026-02-13T05:58:06.251 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72120-0-256 2026-02-13T05:58:06.251 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:58:06.482 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:58:06.482 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:06.483 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:58:06.483 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:58:06.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-13T05:58:06.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-13T05:58:06.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=1 2026-02-13T05:58:06.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-13T05:58:06.817 INFO:tasks.workunit.client.0.trial024.stderr:noout is set 2026-02-13T05:58:06.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' add = add ']' 2026-02-13T05:58:06.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72120-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:06.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:58:06.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:58:06.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-13T05:58:06.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:58:06.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72120-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:06.829 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:58:06.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:58:06.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-13T05:58:06.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:58:06.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-13T05:58:06.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:58:06.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:58:06.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:58:06.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:58:06.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:58:07.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:58:07.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72120-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:07.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:58:07.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:58:07.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T05:58:07.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:58:07.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-13T05:58:07.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72120-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:07.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-13T05:58:07.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:58:07.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:58:07.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T05:58:07.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:58:07.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:58:07.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:58:07.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:58:07.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:58:07.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:58:07.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:58:07.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:58:07.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:58:07.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:58:07.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:58:07.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:58:07.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:58:07.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:58:07.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:58:07.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:58:07.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:58:07.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T05:58:07.241 INFO:tasks.workunit.client.0.trial024.stderr:start osd.1 2026-02-13T05:58:07.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:58:07.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-13T05:58:07.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T05:58:07.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:58:07.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:58:07.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:58:07.254 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:07.254+0000 7ff1bd097900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:07.256 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:07.255+0000 7ff1bd097900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:07.257 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:07.256+0000 7ff1bd097900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:07.397 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:07.395+0000 7ff1bd097900 -1 Falling back to public interface 2026-02-13T05:58:07.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T05:58:07.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:58:07.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:58:07.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:58:07.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:58:07.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:07.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:58:07.462 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:58:07.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:07.462 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:58:07.685 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:58:07.761 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:07.759+0000 7ff1bd097900 -1 osd.1 86 log_to_monitors true 2026-02-13T05:58:08.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:58:08.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:08.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:58:08.687 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:08.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:08.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:58:08.914 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 up in weight 1 up_from 92 up_thru 92 down_at 89 last_clean_interval [68,86) [v2:127.0.0.1:6810/1755643403,v1:127.0.0.1:6811/1755643403] [v2:127.0.0.1:6812/1755643403,v1:127.0.0.1:6813/1755643403] exists,up dc0d2834-1486-4fda-a8bc-0945f2d718fb 2026-02-13T05:58:08.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:58:08.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:58:08.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:58:08.914 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:58:08.915 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:58:08.915 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:58:08.915 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:58:08.915 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:58:08.915 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:58:08.915 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:58:08.916 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:58:08.916 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:58:08.916 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:58:09.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:58:09.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:58:09.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:58:09.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:58:09.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:58:09.002 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:58:09.229 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:58:09.229 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:09.229 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:58:09.230 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:58:09.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:58:09.230 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:09.230 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:58:09.295 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803803 2026-02-13T05:58:09.295 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803803 2026-02-13T05:58:09.295 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803803' 2026-02-13T05:58:09.295 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:09.295 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:58:09.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=395136991235 2026-02-13T05:58:09.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 395136991235 2026-02-13T05:58:09.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803803 1-395136991235' 2026-02-13T05:58:09.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:09.359 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:58:09.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378650 2026-02-13T05:58:09.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378650 2026-02-13T05:58:09.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803803 1-395136991235 2-81604378650' 2026-02-13T05:58:09.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:09.422 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:58:09.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=356482285574 2026-02-13T05:58:09.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 356482285574 2026-02-13T05:58:09.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803803 1-395136991235 2-81604378650 3-356482285574' 2026-02-13T05:58:09.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:09.485 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803803 2026-02-13T05:58:09.485 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:09.486 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:58:09.487 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803803 2026-02-13T05:58:09.487 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:09.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803803 2026-02-13T05:58:09.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803803' 2026-02-13T05:58:09.488 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803803 2026-02-13T05:58:09.488 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:58:09.713 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803803 -lt 25769803803 2026-02-13T05:58:09.713 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:09.713 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-395136991235 2026-02-13T05:58:09.713 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:09.714 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:58:09.715 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-395136991235 2026-02-13T05:58:09.715 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:09.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=395136991235 2026-02-13T05:58:09.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 395136991235' 2026-02-13T05:58:09.716 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 395136991235 2026-02-13T05:58:09.717 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:58:09.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 395136991235 -lt 395136991235 2026-02-13T05:58:09.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:09.939 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378650 2026-02-13T05:58:09.939 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:09.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:58:09.940 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378650 2026-02-13T05:58:09.941 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:09.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378650 2026-02-13T05:58:09.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378650' 2026-02-13T05:58:09.942 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 81604378650 2026-02-13T05:58:09.942 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:58:10.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378650 -lt 81604378650 2026-02-13T05:58:10.165 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:10.165 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-356482285574 2026-02-13T05:58:10.165 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:10.166 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:58:10.166 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-356482285574 2026-02-13T05:58:10.167 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:10.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=356482285574 2026-02-13T05:58:10.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 356482285574' 2026-02-13T05:58:10.168 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 356482285574 2026-02-13T05:58:10.168 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:58:10.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 356482285574 -lt 356482285574 2026-02-13T05:58:10.392 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:58:10.393 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:10.393 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:10.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:58:10.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:58:10.707 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:58:10.707 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:58:10.707 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:58:10.707 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:58:10.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:58:10.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:58:10.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:58:10.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:58:10.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:10.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:11.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:58:11.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:58:11.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:58:11.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:219: set_size: dd if=/dev/urandom bs=256 count=1 2026-02-13T05:58:11.248 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records in 2026-02-13T05:58:11.248 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records out 2026-02-13T05:58:11.249 INFO:tasks.workunit.client.0.trial024.stderr:256 bytes copied, 2.2642e-05 s, 11.3 MB/s 2026-02-13T05:58:11.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72120-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:11.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:58:11.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:58:11.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-13T05:58:11.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:58:11.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72120-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:11.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:58:11.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:58:11.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-13T05:58:11.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:58:11.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-13T05:58:11.250 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:58:11.250 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:58:11.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:58:11.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:58:11.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:58:11.353 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:58:11.353 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72120-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:11.353 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:58:11.353 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:58:11.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T05:58:11.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:58:11.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-13T05:58:11.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72120-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:11.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-13T05:58:11.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:58:11.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:58:11.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T05:58:11.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:58:11.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:58:11.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:58:11.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:58:11.514 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:58:11.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:58:11.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:58:11.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:58:11.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:58:11.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:58:11.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:58:11.515 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:58:11.515 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:11.515 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:11.515 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:11.515 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:11.515 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:11.516 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:11.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:11.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:58:11.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:58:11.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:58:11.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:58:11.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:58:11.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:58:11.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:58:11.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:58:11.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:58:11.516 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:58:11.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T05:58:11.517 INFO:tasks.workunit.client.0.trial024.stderr:start osd.1 2026-02-13T05:58:11.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:58:11.517 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-13T05:58:11.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T05:58:11.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:58:11.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:58:11.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:58:11.529 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:11.528+0000 7fafbb622900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:11.531 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:11.529+0000 7fafbb622900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:11.532 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:11.530+0000 7fafbb622900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:11.650 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:11.648+0000 7fafbb622900 -1 Falling back to public interface 2026-02-13T05:58:11.737 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T05:58:11.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:58:11.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:58:11.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:58:11.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:58:11.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:11.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:58:11.738 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:58:11.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:11.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:58:11.947 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:11.945+0000 7fafbb622900 -1 osd.1 93 log_to_monitors true 2026-02-13T05:58:11.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:58:12.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:58:12.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:12.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:58:12.965 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:12.965 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:12.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:58:13.189 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 up in weight 1 up_from 97 up_thru 97 down_at 94 last_clean_interval [92,93) [v2:127.0.0.1:6810/3110296842,v1:127.0.0.1:6811/3110296842] [v2:127.0.0.1:6812/3110296842,v1:127.0.0.1:6813/3110296842] exists,up dc0d2834-1486-4fda-a8bc-0945f2d718fb 2026-02-13T05:58:13.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:58:13.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:58:13.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:58:13.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:58:13.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:58:13.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:58:13.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:58:13.190 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:58:13.191 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:58:13.191 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:58:13.191 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:58:13.191 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:58:13.191 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:58:13.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:58:13.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:58:13.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:58:13.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:58:13.277 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:58:13.277 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:58:13.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:58:13.503 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:13.503 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:58:13.503 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:58:13.503 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:58:13.504 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:13.504 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:58:13.567 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803806 2026-02-13T05:58:13.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803806 2026-02-13T05:58:13.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803806' 2026-02-13T05:58:13.568 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:13.568 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:58:13.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=416611827715 2026-02-13T05:58:13.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 416611827715 2026-02-13T05:58:13.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803806 1-416611827715' 2026-02-13T05:58:13.632 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:13.633 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:58:13.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378653 2026-02-13T05:58:13.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378653 2026-02-13T05:58:13.696 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803806 1-416611827715 2-81604378653' 2026-02-13T05:58:13.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:13.697 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:58:13.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=356482285577 2026-02-13T05:58:13.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 356482285577 2026-02-13T05:58:13.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803806 1-416611827715 2-81604378653 3-356482285577' 2026-02-13T05:58:13.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:13.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803806 2026-02-13T05:58:13.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:13.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:58:13.763 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803806 2026-02-13T05:58:13.763 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:13.764 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803806 2026-02-13T05:58:13.764 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803806' 2026-02-13T05:58:13.764 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803806 2026-02-13T05:58:13.764 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:58:13.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803806 -lt 25769803806 2026-02-13T05:58:13.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:13.987 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-416611827715 2026-02-13T05:58:13.987 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:13.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:58:13.988 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-416611827715 2026-02-13T05:58:13.989 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:13.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=416611827715 2026-02-13T05:58:13.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 416611827715' 2026-02-13T05:58:13.990 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 416611827715 2026-02-13T05:58:13.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:58:14.215 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 416611827715 2026-02-13T05:58:14.215 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:58:15.216 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:58:15.216 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:58:15.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 416611827715 2026-02-13T05:58:15.440 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:58:16.441 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T05:58:16.441 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:58:16.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 416611827715 -lt 416611827715 2026-02-13T05:58:16.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:16.669 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378653 2026-02-13T05:58:16.670 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:16.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:58:16.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378653 2026-02-13T05:58:16.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:16.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378653 2026-02-13T05:58:16.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378653' 2026-02-13T05:58:16.673 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 81604378653 2026-02-13T05:58:16.673 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:58:16.895 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378654 -lt 81604378653 2026-02-13T05:58:16.895 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:16.896 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-356482285577 2026-02-13T05:58:16.896 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:16.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:58:16.898 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-356482285577 2026-02-13T05:58:16.898 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:16.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=356482285577 2026-02-13T05:58:16.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 356482285577' 2026-02-13T05:58:16.899 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 356482285577 2026-02-13T05:58:16.899 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:58:17.123 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 356482285577 -lt 356482285577 2026-02-13T05:58:17.123 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:58:17.124 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:17.124 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:17.436 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:58:17.436 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:58:17.437 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:58:17.437 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:58:17.437 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:58:17.438 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:58:17.438 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:58:17.438 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:58:17.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:58:17.661 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:58:17.662 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:17.662 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:17.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:58:17.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:58:17.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:58:17.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-13T05:58:17.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-13T05:58:18.287 INFO:tasks.workunit.client.0.trial024.stderr:noout is unset 2026-02-13T05:58:18.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:253: rados_get_data_bad_size: '[' 0 -eq 1 -a 1 -eq 2 ']' 2026-02-13T05:58:18.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:262: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72120-0-256 fail 2026-02-13T05:58:18.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:58:18.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:58:18.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72120-0-256 2026-02-13T05:58:18.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-13T05:58:18.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-13T05:58:18.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-size-72120-0-256 td/test-erasure-eio/COPY 2026-02-13T05:58:18.317 INFO:tasks.workunit.client.0.trial024.stderr:error getting pool-jerasure/obj-size-72120-0-256: (5) Input/output error 2026-02-13T05:58:18.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-13T05:58:18.318 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:264: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-13T05:58:18.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:332: TEST_rados_get_bad_size_shard_0: delete_erasure_coded_pool pool-jerasure 2026-02-13T05:58:18.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:58:18.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T05:58:18.552 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T05:58:18.560 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T05:58:18.838 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T05:58:18.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T05:58:18.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:58:18.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:58:18.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:58:18.847 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:58:18.847 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:58:18.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:58:18.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:58:18.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:58:18.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:58:18.956 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:58:18.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:58:18.958 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:58:18.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:58:18.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:58:18.960 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:58:18.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:58:18.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:58:18.961 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:58:18.961 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:58:18.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:58:18.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:58:18.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:58:18.979 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:58:18.979 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:18.979 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:18.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:58:18.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:58:18.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:58:18.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T05:58:18.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T05:58:18.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T05:58:18.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T05:58:18.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:58:18.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:58:18.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:58:18.982 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:58:18.982 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:58:18.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:58:18.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:58:18.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:58:18.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:58:18.983 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:58:18.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:58:18.984 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:58:18.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:58:18.985 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:58:18.985 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:58:18.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:58:18.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:58:18.986 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:58:18.987 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:58:18.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:58:18.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:58:18.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:58:18.989 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:58:18.989 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:18.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:18.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:58:18.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:58:18.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:58:18.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T05:58:18.992 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:58:18.992 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:18.992 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:18.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T05:58:18.993 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:58:18.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:58:18.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:58:18.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T05:58:18.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T05:58:18.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T05:58:18.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:58:18.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:58:18.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:58:18.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T05:58:18.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T05:58:19.015 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:58:19.015 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:19.015 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:19.015 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:19.015 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:19.015 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:19.016 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:19.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:58:19.042 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:58:19.043 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:58:19.043 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:58:19.043 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:58:19.043 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:58:19.043 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:58:19.044 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:58:19.045 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:58:19.045 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:58:19.045 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:58:19.045 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:19.045 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:19.045 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:58:19.045 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:58:19.045 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T05:58:19.089 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:58:19.090 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:58:19.090 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:58:19.090 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:58:19.090 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:58:19.091 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:58:19.091 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:58:19.091 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:58:19.091 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:58:19.092 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:19.092 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:19.092 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:58:19.092 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:58:19.092 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T05:58:19.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T05:58:19.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T05:58:19.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:58:19.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:58:19.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:58:19.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T05:58:19.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:58:19.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:58:19.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:19.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:19.235 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:19.235 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:19.235 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:19.235 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:19.236 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:58:19.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:58:19.253 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T05:58:19.253 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:58:19.349 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:58:19.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:58:20.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T05:58:20.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:58:20.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:58:20.357 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:58:20.357 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:20.358 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:20.358 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:58:20.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T05:58:20.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T05:58:20.398 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:58:20.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T05:58:20.404 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:58:19.034+0000 7fd6c020cd80 0 load: jerasure load: lrc 2026-02-13T05:58:20.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_bad_size_shard_1 td/test-erasure-eio 2026-02-13T05:58:20.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:336: TEST_rados_get_bad_size_shard_1: local dir=td/test-erasure-eio 2026-02-13T05:58:20.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:337: TEST_rados_get_bad_size_shard_1: setup_osds 4 2026-02-13T05:58:20.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-13T05:58:20.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T05:58:20.405 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-13T05:58:20.406 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-13T05:58:20.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:58:20.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T05:58:20.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:58:20.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:58:20.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:58:20.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:58:20.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T05:58:20.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:58:20.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:58:20.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:58:20.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:58:20.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T05:58:20.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T05:58:20.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:58:20.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:58:20.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:58:20.411 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:58:20.411 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:20.411 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:58:20.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:58:20.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:58:20.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:58:20.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:58:20.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T05:58:20.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:58:20.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f8d77ecb-f6aa-4238-aba6-cdf2a208fcdf 2026-02-13T05:58:20.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 f8d77ecb-f6aa-4238-aba6-cdf2a208fcdf' 2026-02-13T05:58:20.414 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 f8d77ecb-f6aa-4238-aba6-cdf2a208fcdf 2026-02-13T05:58:20.414 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:58:20.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB8vY5pF9MsGRAAGhP8Ag8Lvi6uW0WItOOhgA== 2026-02-13T05:58:20.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB8vY5pF9MsGRAAGhP8Ag8Lvi6uW0WItOOhgA=="}' 2026-02-13T05:58:20.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f8d77ecb-f6aa-4238-aba6-cdf2a208fcdf -i td/test-erasure-eio/0/new.json 2026-02-13T05:58:20.528 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:58:20.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T05:58:20.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB8vY5pF9MsGRAAGhP8Ag8Lvi6uW0WItOOhgA== --osd-uuid f8d77ecb-f6aa-4238-aba6-cdf2a208fcdf 2026-02-13T05:58:20.554 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:20.552+0000 7fbb31612900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:20.555 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:20.554+0000 7fbb31612900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:20.556 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:20.555+0000 7fbb31612900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:20.557 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:20.555+0000 7fbb31612900 -1 bdev(0x55ab17b44c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:58:20.557 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:20.555+0000 7fbb31612900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T05:58:20.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T05:58:20.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:58:20.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:58:20.964 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:58:20.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:58:21.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:58:21.067 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:58:21.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:58:21.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:58:21.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:58:21.068 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:58:21.084 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:21.082+0000 7f16d7f05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:21.085 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:21.084+0000 7f16d7f05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:21.086 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:21.085+0000 7f16d7f05900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:21.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:58:21.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:58:21.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:58:21.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:58:21.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:58:21.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:21.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:58:21.171 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:58:21.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:21.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:58:21.265 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:58:21.290 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:21.288+0000 7f16d7f05900 -1 Falling back to public interface 2026-02-13T05:58:21.548 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:21.547+0000 7f16d7f05900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:58:22.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:58:22.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:22.266 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:58:22.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:58:22.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:22.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:58:22.488 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4118685656,v1:127.0.0.1:6803/4118685656] [v2:127.0.0.1:6804/4118685656,v1:127.0.0.1:6805/4118685656] exists,up f8d77ecb-f6aa-4238-aba6-cdf2a208fcdf 2026-02-13T05:58:22.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:58:22.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:58:22.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:22.489 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:58:22.490 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:58:22.491 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:58:22.491 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:58:22.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=543fd345-711c-4266-bbd5-4f4eac39a0d4 2026-02-13T05:58:22.492 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 543fd345-711c-4266-bbd5-4f4eac39a0d4 2026-02-13T05:58:22.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 543fd345-711c-4266-bbd5-4f4eac39a0d4' 2026-02-13T05:58:22.492 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:58:22.504 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB+vY5pkuANHhAAgCC42QNJKFdPXg5V1Qec1g== 2026-02-13T05:58:22.504 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB+vY5pkuANHhAAgCC42QNJKFdPXg5V1Qec1g=="}' 2026-02-13T05:58:22.504 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 543fd345-711c-4266-bbd5-4f4eac39a0d4 -i td/test-erasure-eio/1/new.json 2026-02-13T05:58:22.732 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:58:22.740 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T05:58:22.741 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB+vY5pkuANHhAAgCC42QNJKFdPXg5V1Qec1g== --osd-uuid 543fd345-711c-4266-bbd5-4f4eac39a0d4 2026-02-13T05:58:22.759 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:22.757+0000 7fd56ca65900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:22.760 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:22.759+0000 7fd56ca65900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:22.761 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:22.760+0000 7fd56ca65900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:22.762 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:22.760+0000 7fd56ca65900 -1 bdev(0x5616d44ecc00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:58:22.762 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:22.760+0000 7fd56ca65900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T05:58:23.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T05:58:23.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:58:23.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:58:23.092 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:58:23.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:58:23.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:58:23.404 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:58:23.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:58:23.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:58:23.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:58:23.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:58:23.421 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:23.420+0000 7f96d27bf900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:23.423 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:23.421+0000 7f96d27bf900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:23.424 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:23.422+0000 7f96d27bf900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:23.562 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:23.560+0000 7f96d27bf900 -1 Falling back to public interface 2026-02-13T05:58:23.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:58:23.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:58:23.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:58:23.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:58:23.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:58:23.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:23.633 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:58:23.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:58:23.633 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:23.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:58:23.841 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:23.839+0000 7f96d27bf900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:58:23.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:58:24.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:58:24.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:24.857 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:58:24.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:58:24.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:24.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:58:25.083 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2931317477,v1:127.0.0.1:6811/2931317477] [v2:127.0.0.1:6812/2931317477,v1:127.0.0.1:6813/2931317477] exists,up 543fd345-711c-4266-bbd5-4f4eac39a0d4 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:25.084 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:58:25.085 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:58:25.086 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:58:25.087 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=105b8e77-2fa7-4465-8106-0a12b53c1527 2026-02-13T05:58:25.087 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 105b8e77-2fa7-4465-8106-0a12b53c1527' 2026-02-13T05:58:25.087 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 105b8e77-2fa7-4465-8106-0a12b53c1527 2026-02-13T05:58:25.087 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:58:25.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCBvY5p31/fBRAAIJhIxlbZHA9VB5myh/yhFQ== 2026-02-13T05:58:25.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCBvY5p31/fBRAAIJhIxlbZHA9VB5myh/yhFQ=="}' 2026-02-13T05:58:25.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 105b8e77-2fa7-4465-8106-0a12b53c1527 -i td/test-erasure-eio/2/new.json 2026-02-13T05:58:25.333 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:58:25.340 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T05:58:25.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCBvY5p31/fBRAAIJhIxlbZHA9VB5myh/yhFQ== --osd-uuid 105b8e77-2fa7-4465-8106-0a12b53c1527 2026-02-13T05:58:25.359 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:25.358+0000 7fb607814900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:25.360 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:25.359+0000 7fb607814900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:25.361 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:25.360+0000 7fb607814900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:25.362 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:25.360+0000 7fb607814900 -1 bdev(0x55a1f92eec00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:58:25.362 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:25.360+0000 7fb607814900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T05:58:25.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T05:58:25.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:58:25.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:58:25.674 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:58:25.675 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:58:26.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:58:26.002 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:58:26.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:58:26.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:58:26.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:58:26.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:58:26.020 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:26.018+0000 7f648566b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:26.021 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:26.020+0000 7f648566b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:26.022 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:26.021+0000 7f648566b900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:26.186 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:26.184+0000 7f648566b900 -1 Falling back to public interface 2026-02-13T05:58:26.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:58:26.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:58:26.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:58:26.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:58:26.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:58:26.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:26.227 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:58:26.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:58:26.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:26.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:58:26.449 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:58:26.527 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:26.526+0000 7f648566b900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:58:27.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:58:27.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:27.451 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:58:27.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:58:27.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:27.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:58:27.672 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 19 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2076607840,v1:127.0.0.1:6819/2076607840] [v2:127.0.0.1:6820/2076607840,v1:127.0.0.1:6821/2076607840] exists,up 105b8e77-2fa7-4465-8106-0a12b53c1527 2026-02-13T05:58:27.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:58:27.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:58:27.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:58:27.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:58:27.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T05:58:27.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:27.673 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:58:27.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:58:27.675 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:58:27.676 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8a175108-3883-440e-8af4-b9dadeffeac9 2026-02-13T05:58:27.676 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 8a175108-3883-440e-8af4-b9dadeffeac9' 2026-02-13T05:58:27.676 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 8a175108-3883-440e-8af4-b9dadeffeac9 2026-02-13T05:58:27.676 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:58:27.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCDvY5pVvX7KBAAY14moxY0UsGJF5gBzNB1Hg== 2026-02-13T05:58:27.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCDvY5pVvX7KBAAY14moxY0UsGJF5gBzNB1Hg=="}' 2026-02-13T05:58:27.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8a175108-3883-440e-8af4-b9dadeffeac9 -i td/test-erasure-eio/3/new.json 2026-02-13T05:58:27.915 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T05:58:27.923 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T05:58:27.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCDvY5pVvX7KBAAY14moxY0UsGJF5gBzNB1Hg== --osd-uuid 8a175108-3883-440e-8af4-b9dadeffeac9 2026-02-13T05:58:27.942 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:27.942+0000 7f26937c6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:27.944 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:27.943+0000 7f26937c6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:27.945 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:27.944+0000 7f26937c6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:27.945 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:27.945+0000 7f26937c6900 -1 bdev(0x55c184932c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T05:58:27.945 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:27.945+0000 7f26937c6900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T05:58:28.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T05:58:28.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:58:28.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T05:58:28.264 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T05:58:28.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:58:28.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T05:58:28.574 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:58:28.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:58:28.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:58:28.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:58:28.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:58:28.591 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:28.591+0000 7fa6b4a27900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:28.592 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:28.592+0000 7fa6b4a27900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:28.593 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:28.593+0000 7fa6b4a27900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:28.735 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:28.735+0000 7fa6b4a27900 -1 Falling back to public interface 2026-02-13T05:58:28.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T05:58:28.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:58:28.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:58:28.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:58:28.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:58:28.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:28.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:58:28.812 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:58:28.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:28.813 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:58:29.033 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:58:29.044 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:29.043+0000 7fa6b4a27900 -1 osd.3 0 log_to_monitors true 2026-02-13T05:58:30.034 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:58:30.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:30.035 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:58:30.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:58:30.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:30.036 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:58:30.260 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 26 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3405382077,v1:127.0.0.1:6827/3405382077] [v2:127.0.0.1:6828/3405382077,v1:127.0.0.1:6829/3405382077] exists,up 8a175108-3883-440e-8af4-b9dadeffeac9 2026-02-13T05:58:30.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:58:30.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:58:30.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:58:30.262 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T05:58:30.262 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:58:30.262 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:58:30.262 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:58:30.262 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:30.262 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:30.262 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:58:30.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T05:58:30.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T05:58:30.306 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:58:30.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T05:58:30.312 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:58:21.291+0000 7f16d7f05900 0 load: jerasure load: lrc 2026-02-13T05:58:30.313 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:339: TEST_rados_get_bad_size_shard_1: local poolname=pool-jerasure 2026-02-13T05:58:30.313 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:340: TEST_rados_get_bad_size_shard_1: create_erasure_coded_pool pool-jerasure 2 1 2026-02-13T05:58:30.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:58:30.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T05:58:30.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-13T05:58:30.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T05:58:30.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-13T05:58:30.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T05:58:30.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-13T05:58:30.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T05:58:30.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T05:58:30.974 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T05:58:30.982 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:58:31.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T05:58:31.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:58:31.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:58:31.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:58:31.983 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:58:31.984 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:58:31.984 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:58:31.984 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:58:31.984 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:58:31.984 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:58:32.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:58:32.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:58:32.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:58:32.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:58:32.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:58:32.072 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:58:32.296 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:58:32.296 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:32.296 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:58:32.296 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:58:32.296 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:58:32.296 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:32.296 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:58:32.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803780 2026-02-13T05:58:32.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803780 2026-02-13T05:58:32.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780' 2026-02-13T05:58:32.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:32.361 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:58:32.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-13T05:58:32.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-13T05:58:32.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852' 2026-02-13T05:58:32.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:32.426 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:58:32.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378627 2026-02-13T05:58:32.488 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378627 2026-02-13T05:58:32.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852 2-81604378627' 2026-02-13T05:58:32.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:32.489 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:58:32.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149700 2026-02-13T05:58:32.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149700 2026-02-13T05:58:32.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852 2-81604378627 3-111669149700' 2026-02-13T05:58:32.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:32.554 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803780 2026-02-13T05:58:32.554 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:32.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:58:32.555 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803780 2026-02-13T05:58:32.555 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:32.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803780 2026-02-13T05:58:32.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803780' 2026-02-13T05:58:32.557 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803780 2026-02-13T05:58:32.557 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:58:32.783 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803778 -lt 25769803780 2026-02-13T05:58:32.783 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:58:33.784 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:58:33.784 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:58:34.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803780 2026-02-13T05:58:34.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:34.010 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574852 2026-02-13T05:58:34.010 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:34.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:58:34.012 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574852 2026-02-13T05:58:34.012 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:34.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574852 2026-02-13T05:58:34.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574852' 2026-02-13T05:58:34.013 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 55834574852 2026-02-13T05:58:34.014 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:58:34.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-13T05:58:34.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:34.234 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378627 2026-02-13T05:58:34.234 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:34.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:58:34.236 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378627 2026-02-13T05:58:34.236 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:34.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378627 2026-02-13T05:58:34.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378627' 2026-02-13T05:58:34.237 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 81604378627 2026-02-13T05:58:34.237 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:58:34.467 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378628 -lt 81604378627 2026-02-13T05:58:34.467 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:34.468 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149700 2026-02-13T05:58:34.468 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:34.469 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:58:34.469 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149700 2026-02-13T05:58:34.470 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:34.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149700 2026-02-13T05:58:34.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149700' 2026-02-13T05:58:34.471 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 111669149700 2026-02-13T05:58:34.471 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:58:34.692 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149700 -lt 111669149700 2026-02-13T05:58:34.692 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:58:34.693 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:34.693 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:35.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:58:35.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:58:35.005 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:58:35.005 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:58:35.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:58:35.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:58:35.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:58:35.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:58:35.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:58:35.225 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:58:35.226 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:35.226 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:35.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:58:35.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:58:35.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:58:35.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:342: TEST_rados_get_bad_size_shard_1: local shard_id=1 2026-02-13T05:58:35.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:343: TEST_rados_get_bad_size_shard_1: rados_get_data_bad_size td/test-erasure-eio 1 10 2026-02-13T05:58:35.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-13T05:58:35.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:233: rados_get_data_bad_size: shift 2026-02-13T05:58:35.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:234: rados_get_data_bad_size: local shard_id=1 2026-02-13T05:58:35.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:235: rados_get_data_bad_size: shift 2026-02-13T05:58:35.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: local bytes=10 2026-02-13T05:58:35.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:237: rados_get_data_bad_size: shift 2026-02-13T05:58:35.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: local mode=set 2026-02-13T05:58:35.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:240: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-13T05:58:35.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: local objname=obj-size-72120-1-10 2026-02-13T05:58:35.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-72120-1-10 2026-02-13T05:58:35.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:58:35.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:58:35.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-72120-1-10 2026-02-13T05:58:35.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:58:35.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:58:35.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:58:35.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:58:35.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:58:35.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:58:35.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:58:35.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:58:35.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-72120-1-10 td/test-erasure-eio/ORIGINAL 2026-02-13T05:58:35.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:246: rados_get_data_bad_size: set_size obj-size-72120-1-10 td/test-erasure-eio 1 10 set 2026-02-13T05:58:35.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72120-1-10 2026-02-13T05:58:35.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-13T05:58:35.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-13T05:58:35.570 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-13T05:58:35.570 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=1 2026-02-13T05:58:35.570 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-13T05:58:35.570 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=10 2026-02-13T05:58:35.570 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-13T05:58:35.570 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-13T05:58:35.570 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-13T05:58:35.570 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72120-1-10 2026-02-13T05:58:35.570 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:58:35.570 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72120-1-10 2026-02-13T05:58:35.570 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72120-1-10 2026-02-13T05:58:35.570 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:58:35.804 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:58:35.804 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:35.804 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:58:35.804 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:58:35.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-13T05:58:35.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-13T05:58:35.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=1 2026-02-13T05:58:35.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-13T05:58:36.083 INFO:tasks.workunit.client.0.trial024.stderr:noout is set 2026-02-13T05:58:36.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-13T05:58:36.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 10 = 0 ']' 2026-02-13T05:58:36.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: set_size: dd if=/dev/urandom bs=10 count=1 of=td/test-erasure-eio/CORRUPT 2026-02-13T05:58:36.094 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records in 2026-02-13T05:58:36.094 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records out 2026-02-13T05:58:36.094 INFO:tasks.workunit.client.0.trial024.stderr:10 bytes copied, 4.3771e-05 s, 228 kB/s 2026-02-13T05:58:36.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72120-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:36.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:58:36.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:58:36.094 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-13T05:58:36.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:58:36.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72120-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:36.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:58:36.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:58:36.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-13T05:58:36.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:58:36.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-13T05:58:36.095 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:58:36.095 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:58:36.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:58:36.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:58:36.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:58:36.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:58:36.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72120-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:36.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:58:36.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:58:36.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T05:58:36.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:58:36.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-13T05:58:36.401 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72120-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:36.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-13T05:58:36.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:58:36.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:36.547 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:58:36.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:58:36.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T05:58:36.549 INFO:tasks.workunit.client.0.trial024.stderr:start osd.1 2026-02-13T05:58:36.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:58:36.549 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-13T05:58:36.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T05:58:36.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:58:36.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:58:36.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:58:36.565 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:36.564+0000 7f889600d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:36.566 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:36.565+0000 7f889600d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:36.567 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:36.566+0000 7f889600d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:36.698 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:36.697+0000 7f889600d900 -1 Falling back to public interface 2026-02-13T05:58:36.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T05:58:36.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:58:36.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:58:36.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:58:36.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:58:36.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:36.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:58:36.776 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:58:36.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:36.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:58:36.974 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:36.974+0000 7f889600d900 -1 osd.1 34 log_to_monitors true 2026-02-13T05:58:36.998 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:58:37.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:58:37.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:37.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:58:38.000 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:38.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:38.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:58:38.222 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 up in weight 1 up_from 39 up_thru 39 down_at 36 last_clean_interval [13,34) [v2:127.0.0.1:6810/4182931590,v1:127.0.0.1:6811/4182931590] [v2:127.0.0.1:6812/4182931590,v1:127.0.0.1:6813/4182931590] exists,up 543fd345-711c-4266-bbd5-4f4eac39a0d4 2026-02-13T05:58:38.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:58:38.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:58:38.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:58:38.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:58:38.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:58:38.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:58:38.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:58:38.223 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:58:38.223 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:58:38.224 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:58:38.224 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:58:38.224 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:58:38.224 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:58:38.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:58:38.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:58:38.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:58:38.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:58:38.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:58:38.308 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:58:38.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:58:38.530 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:38.530 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:58:38.530 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:58:38.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:58:38.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:38.531 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:58:38.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803784 2026-02-13T05:58:38.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803784 2026-02-13T05:58:38.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784' 2026-02-13T05:58:38.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:38.595 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:58:38.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724547 2026-02-13T05:58:38.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724547 2026-02-13T05:58:38.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-167503724547' 2026-02-13T05:58:38.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:38.659 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:58:38.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378631 2026-02-13T05:58:38.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378631 2026-02-13T05:58:38.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-167503724547 2-81604378631' 2026-02-13T05:58:38.726 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:38.726 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:58:38.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149703 2026-02-13T05:58:38.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149703 2026-02-13T05:58:38.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-167503724547 2-81604378631 3-111669149703' 2026-02-13T05:58:38.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:38.792 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803784 2026-02-13T05:58:38.792 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:38.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:58:38.794 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803784 2026-02-13T05:58:38.794 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:38.795 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803784 2026-02-13T05:58:38.795 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803784' 2026-02-13T05:58:38.795 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803784 2026-02-13T05:58:38.795 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:58:39.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803784 2026-02-13T05:58:39.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:58:40.016 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:58:40.016 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:58:40.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803784 -lt 25769803784 2026-02-13T05:58:40.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:40.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-167503724547 2026-02-13T05:58:40.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:40.242 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:58:40.243 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-167503724547 2026-02-13T05:58:40.243 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:40.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=167503724547 2026-02-13T05:58:40.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 167503724547' 2026-02-13T05:58:40.244 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 167503724547 2026-02-13T05:58:40.244 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:58:40.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 167503724547 -lt 167503724547 2026-02-13T05:58:40.471 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:40.472 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-81604378631 2026-02-13T05:58:40.472 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:40.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:58:40.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-81604378631 2026-02-13T05:58:40.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:40.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=81604378631 2026-02-13T05:58:40.474 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 81604378631' 2026-02-13T05:58:40.475 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 81604378631 2026-02-13T05:58:40.475 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:58:40.697 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 81604378631 -lt 81604378631 2026-02-13T05:58:40.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:40.698 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149703 2026-02-13T05:58:40.698 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:40.699 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:58:40.700 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149703 2026-02-13T05:58:40.700 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:40.701 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149703 2026-02-13T05:58:40.701 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149703' 2026-02-13T05:58:40.701 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 111669149703 2026-02-13T05:58:40.702 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:58:40.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149703 -lt 111669149703 2026-02-13T05:58:40.925 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:58:40.925 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:40.926 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:41.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:58:41.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:58:41.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:58:41.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:58:41.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:58:41.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:58:41.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:58:41.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:58:41.463 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:58:41.464 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:58:41.464 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:41.464 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:41.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:58:41.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:58:41.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:58:41.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-13T05:58:41.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-13T05:58:42.097 INFO:tasks.workunit.client.0.trial024.stderr:noout is unset 2026-02-13T05:58:42.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:248: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72120-1-10 2026-02-13T05:58:42.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:58:42.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:58:42.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72120-1-10 2026-02-13T05:58:42.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:58:42.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:58:42.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72120-1-10 td/test-erasure-eio/COPY 2026-02-13T05:58:42.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:58:42.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:58:42.132 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: expr 1 + 1 2026-02-13T05:58:42.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: local another_shard_id=2 2026-02-13T05:58:42.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:252: rados_get_data_bad_size: set_size obj-size-72120-1-10 td/test-erasure-eio 2 10 set 2026-02-13T05:58:42.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72120-1-10 2026-02-13T05:58:42.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-13T05:58:42.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-13T05:58:42.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-13T05:58:42.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=2 2026-02-13T05:58:42.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-13T05:58:42.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=10 2026-02-13T05:58:42.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-13T05:58:42.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-13T05:58:42.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-13T05:58:42.135 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72120-1-10 2026-02-13T05:58:42.135 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:58:42.135 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72120-1-10 2026-02-13T05:58:42.135 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72120-1-10 2026-02-13T05:58:42.135 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:58:42.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:58:42.357 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:42.357 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:58:42.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:58:42.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-13T05:58:42.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-13T05:58:42.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=2 2026-02-13T05:58:42.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-13T05:58:42.671 INFO:tasks.workunit.client.0.trial024.stderr:noout is set 2026-02-13T05:58:42.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-13T05:58:42.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 10 = 0 ']' 2026-02-13T05:58:42.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: set_size: dd if=/dev/urandom bs=10 count=1 of=td/test-erasure-eio/CORRUPT 2026-02-13T05:58:42.684 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records in 2026-02-13T05:58:42.684 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records out 2026-02-13T05:58:42.684 INFO:tasks.workunit.client.0.trial024.stderr:10 bytes copied, 3.266e-05 s, 306 kB/s 2026-02-13T05:58:42.684 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 2 obj-size-72120-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:42.684 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:58:42.684 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:58:42.684 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-13T05:58:42.684 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:58:42.685 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-size-72120-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:42.685 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:58:42.685 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:58:42.685 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-13T05:58:42.685 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:58:42.685 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-13T05:58:42.685 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:58:42.685 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:58:42.685 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:58:42.685 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:58:42.685 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:58:42.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:58:42.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-size-72120-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:42.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:58:42.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:58:42.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-13T05:58:42.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:58:42.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-13T05:58:42.991 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-size-72120-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:43.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-13T05:58:43.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:58:43.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:58:43.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T05:58:43.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:58:43.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:58:43.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:58:43.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:58:43.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:58:43.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:58:43.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:58:43.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:58:43.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:58:43.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:58:43.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:58:43.129 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:58:43.129 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:43.130 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:43.130 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:43.130 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:43.130 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:43.130 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:43.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:43.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:58:43.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:58:43.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:58:43.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:58:43.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:58:43.130 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:58:43.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:58:43.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:58:43.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:58:43.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:58:43.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T05:58:43.131 INFO:tasks.workunit.client.0.trial024.stderr:start osd.2 2026-02-13T05:58:43.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:58:43.131 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-13T05:58:43.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T05:58:43.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:58:43.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:58:43.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:58:43.144 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:43.144+0000 7f76efda7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:43.146 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:43.145+0000 7f76efda7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:43.147 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:43.146+0000 7f76efda7900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:43.272 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:43.271+0000 7f76efda7900 -1 Falling back to public interface 2026-02-13T05:58:43.361 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T05:58:43.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:58:43.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:58:43.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:58:43.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:58:43.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:43.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:58:43.362 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:58:43.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:43.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:58:43.547 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:43.546+0000 7f76efda7900 -1 osd.2 42 log_to_monitors true 2026-02-13T05:58:43.588 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:58:44.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:58:44.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:44.589 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:58:44.589 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:44.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:44.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:58:44.811 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 up in weight 1 up_from 48 up_thru 36 down_at 45 last_clean_interval [19,42) [v2:127.0.0.1:6818/732841199,v1:127.0.0.1:6819/732841199] [v2:127.0.0.1:6820/732841199,v1:127.0.0.1:6821/732841199] exists,up 105b8e77-2fa7-4465-8106-0a12b53c1527 2026-02-13T05:58:44.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:58:44.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:58:44.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:58:44.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:58:44.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:58:44.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:58:44.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:58:44.812 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:58:44.813 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:58:44.813 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:58:44.813 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:58:44.813 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:58:44.813 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:58:44.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:58:44.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:58:44.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:58:44.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:58:44.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:58:44.898 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:58:45.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:58:45.119 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:45.119 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:58:45.119 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:58:45.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:58:45.119 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:45.119 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:58:45.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803787 2026-02-13T05:58:45.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803787 2026-02-13T05:58:45.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787' 2026-02-13T05:58:45.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:45.183 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:58:45.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724550 2026-02-13T05:58:45.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724550 2026-02-13T05:58:45.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787 1-167503724550' 2026-02-13T05:58:45.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:45.247 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:58:45.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=206158430211 2026-02-13T05:58:45.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 206158430211 2026-02-13T05:58:45.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787 1-167503724550 2-206158430211' 2026-02-13T05:58:45.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:45.312 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:58:45.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149707 2026-02-13T05:58:45.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149707 2026-02-13T05:58:45.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787 1-167503724550 2-206158430211 3-111669149707' 2026-02-13T05:58:45.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:45.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803787 2026-02-13T05:58:45.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:45.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:58:45.379 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803787 2026-02-13T05:58:45.379 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:45.380 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803787 2026-02-13T05:58:45.381 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803787' 2026-02-13T05:58:45.381 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803787 2026-02-13T05:58:45.381 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:58:45.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803787 -lt 25769803787 2026-02-13T05:58:45.607 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:45.608 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-167503724550 2026-02-13T05:58:45.608 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:45.609 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:58:45.610 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-167503724550 2026-02-13T05:58:45.610 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:45.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=167503724550 2026-02-13T05:58:45.611 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 167503724550' 2026-02-13T05:58:45.611 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 167503724550 2026-02-13T05:58:45.611 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:58:45.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 167503724550 -lt 167503724550 2026-02-13T05:58:45.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:45.836 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-206158430211 2026-02-13T05:58:45.836 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:45.837 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:58:45.838 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-206158430211 2026-02-13T05:58:45.838 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:45.839 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=206158430211 2026-02-13T05:58:45.839 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 206158430211' 2026-02-13T05:58:45.839 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 206158430211 2026-02-13T05:58:45.840 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:58:46.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 206158430211 2026-02-13T05:58:46.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:58:47.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:58:47.065 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:58:47.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 206158430211 2026-02-13T05:58:47.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:58:48.290 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T05:58:48.290 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:58:48.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 206158430211 -lt 206158430211 2026-02-13T05:58:48.515 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:48.516 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149707 2026-02-13T05:58:48.516 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:48.517 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:58:48.517 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149707 2026-02-13T05:58:48.517 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:48.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149707 2026-02-13T05:58:48.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149707' 2026-02-13T05:58:48.519 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 111669149707 2026-02-13T05:58:48.519 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:58:48.738 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149707 -lt 111669149707 2026-02-13T05:58:48.738 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:58:48.739 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:48.739 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:49.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:58:49.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:58:49.055 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:58:49.055 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:58:49.055 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:58:49.055 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:58:49.055 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:58:49.055 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:58:49.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:58:49.276 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:58:49.276 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:49.276 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:49.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:58:49.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:58:49.590 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:58:49.591 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-13T05:58:49.591 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-13T05:58:49.901 INFO:tasks.workunit.client.0.trial024.stderr:noout is unset 2026-02-13T05:58:49.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:253: rados_get_data_bad_size: '[' 1 -eq 1 -a 2 -eq 2 ']' 2026-02-13T05:58:49.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:258: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72120-1-10 2026-02-13T05:58:49.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:58:49.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:58:49.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72120-1-10 2026-02-13T05:58:49.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:58:49.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:58:49.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72120-1-10 td/test-erasure-eio/COPY 2026-02-13T05:58:49.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:58:49.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:58:49.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:264: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-13T05:58:49.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:344: TEST_rados_get_bad_size_shard_1: rados_get_data_bad_size td/test-erasure-eio 1 0 2026-02-13T05:58:49.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-13T05:58:49.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:233: rados_get_data_bad_size: shift 2026-02-13T05:58:49.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:234: rados_get_data_bad_size: local shard_id=1 2026-02-13T05:58:49.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:235: rados_get_data_bad_size: shift 2026-02-13T05:58:49.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: local bytes=0 2026-02-13T05:58:49.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:237: rados_get_data_bad_size: shift 2026-02-13T05:58:49.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: local mode=set 2026-02-13T05:58:49.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:240: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-13T05:58:49.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: local objname=obj-size-72120-1-0 2026-02-13T05:58:49.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-72120-1-0 2026-02-13T05:58:49.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:58:49.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:58:49.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-72120-1-0 2026-02-13T05:58:49.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:58:49.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:58:49.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:58:49.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:58:49.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:58:49.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:58:49.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:58:49.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:58:49.939 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-72120-1-0 td/test-erasure-eio/ORIGINAL 2026-02-13T05:58:49.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:246: rados_get_data_bad_size: set_size obj-size-72120-1-0 td/test-erasure-eio 1 0 set 2026-02-13T05:58:49.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72120-1-0 2026-02-13T05:58:49.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-13T05:58:49.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-13T05:58:49.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-13T05:58:49.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=1 2026-02-13T05:58:49.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-13T05:58:49.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=0 2026-02-13T05:58:49.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-13T05:58:49.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-13T05:58:49.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-13T05:58:49.956 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72120-1-0 2026-02-13T05:58:49.957 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:58:49.957 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72120-1-0 2026-02-13T05:58:49.957 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72120-1-0 2026-02-13T05:58:49.957 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:58:50.184 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:58:50.184 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:50.184 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:58:50.184 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:58:50.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-13T05:58:50.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-13T05:58:50.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=1 2026-02-13T05:58:50.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-13T05:58:50.469 INFO:tasks.workunit.client.0.trial024.stderr:noout is set 2026-02-13T05:58:50.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-13T05:58:50.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 0 = 0 ']' 2026-02-13T05:58:50.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: set_size: touch td/test-erasure-eio/CORRUPT 2026-02-13T05:58:50.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72120-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:50.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:58:50.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:58:50.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-13T05:58:50.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:58:50.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72120-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:50.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:58:50.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:58:50.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-13T05:58:50.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:58:50.482 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-13T05:58:50.482 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:58:50.483 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:58:50.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:58:50.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:58:50.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:58:50.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:58:50.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72120-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:50.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:58:50.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:58:50.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T05:58:50.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:58:50.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-13T05:58:50.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72120-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:50.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-13T05:58:50.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:58:50.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:58:50.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T05:58:50.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:58:50.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:58:50.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:58:50.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:58:50.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:58:50.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:58:50.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:58:50.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:58:50.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:58:50.925 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:58:50.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:58:50.926 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:58:50.926 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:50.926 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:50.926 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:50.926 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:50.926 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:50.926 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:50.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:50.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:58:50.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:58:50.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:58:50.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:58:50.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:58:50.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:58:50.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:58:50.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:58:50.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:58:50.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:58:50.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T05:58:50.927 INFO:tasks.workunit.client.0.trial024.stderr:start osd.1 2026-02-13T05:58:50.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:58:50.927 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-13T05:58:50.928 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T05:58:50.928 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:58:50.928 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:58:50.928 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:58:50.941 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:50.941+0000 7f4116210900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:50.943 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:50.942+0000 7f4116210900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:50.944 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:50.943+0000 7f4116210900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:51.070 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:51.069+0000 7f4116210900 -1 Falling back to public interface 2026-02-13T05:58:51.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T05:58:51.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:58:51.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:58:51.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:58:51.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:58:51.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:51.150 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:58:51.150 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:58:51.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:51.151 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:58:51.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:58:51.379 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:51.378+0000 7f4116210900 -1 osd.1 54 log_to_monitors true 2026-02-13T05:58:52.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:58:52.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:52.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:58:52.377 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:52.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:52.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:58:52.601 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 up in weight 1 up_from 58 up_thru 58 down_at 55 last_clean_interval [39,54) [v2:127.0.0.1:6810/1574133758,v1:127.0.0.1:6811/1574133758] [v2:127.0.0.1:6812/1574133758,v1:127.0.0.1:6813/1574133758] exists,up 543fd345-711c-4266-bbd5-4f4eac39a0d4 2026-02-13T05:58:52.601 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:58:52.601 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:58:52.601 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:58:52.601 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:58:52.601 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:58:52.601 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:58:52.601 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:58:52.601 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:58:52.602 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:58:52.602 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:58:52.602 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:58:52.602 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:58:52.603 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:58:52.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:58:52.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:58:52.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:58:52.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:58:52.687 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:58:52.687 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:58:52.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:58:52.919 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:52.919 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:58:52.919 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:58:52.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:58:52.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:52.920 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:58:52.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803791 2026-02-13T05:58:52.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803791 2026-02-13T05:58:52.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791' 2026-02-13T05:58:52.983 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:52.984 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:58:53.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103171 2026-02-13T05:58:53.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103171 2026-02-13T05:58:53.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-249108103171' 2026-02-13T05:58:53.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:53.048 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:58:53.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=206158430214 2026-02-13T05:58:53.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 206158430214 2026-02-13T05:58:53.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-249108103171 2-206158430214' 2026-02-13T05:58:53.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:53.112 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:58:53.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149710 2026-02-13T05:58:53.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149710 2026-02-13T05:58:53.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803791 1-249108103171 2-206158430214 3-111669149710' 2026-02-13T05:58:53.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:53.177 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803791 2026-02-13T05:58:53.177 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:53.177 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:58:53.178 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803791 2026-02-13T05:58:53.178 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:53.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803791 2026-02-13T05:58:53.179 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803791' 2026-02-13T05:58:53.179 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803791 2026-02-13T05:58:53.180 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:58:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803791 -lt 25769803791 2026-02-13T05:58:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:53.404 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-249108103171 2026-02-13T05:58:53.404 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:53.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:58:53.406 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-249108103171 2026-02-13T05:58:53.406 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:53.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=249108103171 2026-02-13T05:58:53.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 249108103171' 2026-02-13T05:58:53.407 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 249108103171 2026-02-13T05:58:53.408 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:58:53.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 249108103171 -lt 249108103171 2026-02-13T05:58:53.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:53.635 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-206158430214 2026-02-13T05:58:53.636 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:53.637 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:58:53.637 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-206158430214 2026-02-13T05:58:53.638 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:53.638 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=206158430214 2026-02-13T05:58:53.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 206158430214' 2026-02-13T05:58:53.639 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 206158430214 2026-02-13T05:58:53.639 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:58:53.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 206158430214 -lt 206158430214 2026-02-13T05:58:53.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:53.871 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149710 2026-02-13T05:58:53.871 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:53.872 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:58:53.872 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149710 2026-02-13T05:58:53.873 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:53.874 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149710 2026-02-13T05:58:53.874 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149710' 2026-02-13T05:58:53.874 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 111669149710 2026-02-13T05:58:53.874 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:58:54.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149710 -lt 111669149710 2026-02-13T05:58:54.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:58:54.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:54.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:54.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:58:54.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:58:54.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:58:54.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:58:54.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:58:54.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:58:54.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:58:54.413 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:58:54.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:58:54.636 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:58:54.636 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:58:54.636 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:58:54.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:58:54.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:58:54.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:58:54.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-13T05:58:54.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-13T05:58:55.262 INFO:tasks.workunit.client.0.trial024.stderr:noout is unset 2026-02-13T05:58:55.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:248: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72120-1-0 2026-02-13T05:58:55.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:58:55.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:58:55.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72120-1-0 2026-02-13T05:58:55.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:58:55.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:58:55.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72120-1-0 td/test-erasure-eio/COPY 2026-02-13T05:58:55.295 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:58:55.296 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:58:55.297 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: expr 1 + 1 2026-02-13T05:58:55.299 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: local another_shard_id=2 2026-02-13T05:58:55.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:252: rados_get_data_bad_size: set_size obj-size-72120-1-0 td/test-erasure-eio 2 0 set 2026-02-13T05:58:55.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72120-1-0 2026-02-13T05:58:55.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-13T05:58:55.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-13T05:58:55.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-13T05:58:55.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=2 2026-02-13T05:58:55.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-13T05:58:55.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=0 2026-02-13T05:58:55.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-13T05:58:55.300 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=set 2026-02-13T05:58:55.301 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-13T05:58:55.301 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72120-1-0 2026-02-13T05:58:55.301 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:58:55.301 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72120-1-0 2026-02-13T05:58:55.301 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72120-1-0 2026-02-13T05:58:55.301 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:58:55.527 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:58:55.527 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:55.528 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:58:55.528 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:58:55.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-13T05:58:55.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-13T05:58:55.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=2 2026-02-13T05:58:55.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-13T05:58:55.844 INFO:tasks.workunit.client.0.trial024.stderr:noout is set 2026-02-13T05:58:55.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' set = add ']' 2026-02-13T05:58:55.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:220: set_size: '[' 0 = 0 ']' 2026-02-13T05:58:55.855 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: set_size: touch td/test-erasure-eio/CORRUPT 2026-02-13T05:58:55.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 2 obj-size-72120-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:55.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:58:55.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:58:55.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-13T05:58:55.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:58:55.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-size-72120-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:55.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:58:55.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:58:55.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-13T05:58:55.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:58:55.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-13T05:58:55.858 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:58:55.858 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:58:55.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:58:55.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:58:55.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:58:56.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:58:56.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-size-72120-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:56.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:58:56.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:58:56.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-13T05:58:56.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:58:56.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-13T05:58:56.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-size-72120-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:58:56.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-13T05:58:56.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:58:56.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:58:56.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T05:58:56.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:58:56.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:58:56.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:58:56.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:58:56.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:58:56.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:58:56.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:58:56.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:58:56.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:58:56.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:58:56.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:58:56.305 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:58:56.305 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:58:56.305 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:58:56.305 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:58:56.305 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:58:56.305 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:58:56.305 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:58:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:58:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:58:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:58:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:58:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:58:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:58:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:58:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:58:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:58:56.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:58:56.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T05:58:56.307 INFO:tasks.workunit.client.0.trial024.stderr:start osd.2 2026-02-13T05:58:56.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:58:56.307 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-13T05:58:56.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T05:58:56.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:58:56.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:58:56.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:58:56.320 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:56.318+0000 7fb2db346900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:56.321 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:56.320+0000 7fb2db346900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:56.322 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:56.321+0000 7fb2db346900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:58:56.458 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:56.456+0000 7fb2db346900 -1 Falling back to public interface 2026-02-13T05:58:56.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T05:58:56.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:58:56.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:58:56.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:58:56.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:58:56.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:56.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:58:56.528 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:58:56.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:56.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:58:56.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:58:56.806 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:58:56.804+0000 7fb2db346900 -1 osd.2 63 log_to_monitors true 2026-02-13T05:58:57.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:58:57.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:58:57.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:58:57.753 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:57.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:58:57.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:58:57.978 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 up in weight 1 up_from 67 up_thru 55 down_at 64 last_clean_interval [48,63) [v2:127.0.0.1:6818/1616617730,v1:127.0.0.1:6819/1616617730] [v2:127.0.0.1:6820/1616617730,v1:127.0.0.1:6821/1616617730] exists,up 105b8e77-2fa7-4465-8106-0a12b53c1527 2026-02-13T05:58:57.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:58:57.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:58:57.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:58:57.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:58:57.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:58:57.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:58:57.979 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:58:57.979 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:58:57.980 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:58:57.980 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:58:57.980 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:58:57.980 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:58:57.980 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:58:58.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:58:58.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:58:58.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:58:58.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:58:58.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:58:58.064 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:58:58.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:58:58.287 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:58:58.287 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:58:58.287 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:58:58.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:58:58.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:58.288 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:58:58.352 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803794 2026-02-13T05:58:58.353 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803794 2026-02-13T05:58:58.353 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803794' 2026-02-13T05:58:58.353 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:58.353 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:58:58.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103174 2026-02-13T05:58:58.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103174 2026-02-13T05:58:58.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803794 1-249108103174' 2026-02-13T05:58:58.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:58.416 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:58:58.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808835 2026-02-13T05:58:58.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808835 2026-02-13T05:58:58.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803794 1-249108103174 2-287762808835' 2026-02-13T05:58:58.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:58:58.481 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:58:58.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149713 2026-02-13T05:58:58.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149713 2026-02-13T05:58:58.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803794 1-249108103174 2-287762808835 3-111669149713' 2026-02-13T05:58:58.545 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:58.546 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803794 2026-02-13T05:58:58.546 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:58.546 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:58:58.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803794 2026-02-13T05:58:58.547 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:58:58.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803794 2026-02-13T05:58:58.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803794' 2026-02-13T05:58:58.549 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803794 2026-02-13T05:58:58.549 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:58:58.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803791 -lt 25769803794 2026-02-13T05:58:58.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:58:59.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:58:59.775 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:58:59.997 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803794 -lt 25769803794 2026-02-13T05:58:59.998 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:58:59.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-249108103174 2026-02-13T05:58:59.998 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:58:59.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:58:59.999 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-249108103174 2026-02-13T05:59:00.000 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:00.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=249108103174 2026-02-13T05:59:00.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 249108103174' 2026-02-13T05:59:00.001 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 249108103174 2026-02-13T05:59:00.001 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:59:00.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 249108103174 -lt 249108103174 2026-02-13T05:59:00.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:00.225 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-287762808835 2026-02-13T05:59:00.226 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:00.226 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:59:00.227 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-287762808835 2026-02-13T05:59:00.227 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:00.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808835 2026-02-13T05:59:00.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 287762808835' 2026-02-13T05:59:00.228 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 287762808835 2026-02-13T05:59:00.229 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:59:00.457 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808835 -lt 287762808835 2026-02-13T05:59:00.457 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:00.458 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149713 2026-02-13T05:59:00.458 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:00.458 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:59:00.459 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149713 2026-02-13T05:59:00.459 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:00.460 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149713 2026-02-13T05:59:00.460 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149713' 2026-02-13T05:59:00.460 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 111669149713 2026-02-13T05:59:00.461 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:59:00.684 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149713 -lt 111669149713 2026-02-13T05:59:00.685 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:59:00.685 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:59:00.685 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:59:00.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:59:00.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:59:00.994 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:59:00.994 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:59:00.994 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:59:00.995 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:59:00.995 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:59:00.995 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:59:01.219 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:59:01.220 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:59:01.221 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:59:01.221 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:59:01.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:59:01.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:59:01.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:59:01.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-13T05:59:01.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-13T05:59:01.847 INFO:tasks.workunit.client.0.trial024.stderr:noout is unset 2026-02-13T05:59:01.856 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:253: rados_get_data_bad_size: '[' 1 -eq 1 -a 2 -eq 2 ']' 2026-02-13T05:59:01.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:258: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72120-1-0 2026-02-13T05:59:01.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:59:01.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:59:01.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72120-1-0 2026-02-13T05:59:01.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:59:01.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:59:01.857 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72120-1-0 td/test-erasure-eio/COPY 2026-02-13T05:59:01.876 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:59:01.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:59:01.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:264: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:345: TEST_rados_get_bad_size_shard_1: rados_get_data_bad_size td/test-erasure-eio 1 256 add 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:233: rados_get_data_bad_size: shift 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:234: rados_get_data_bad_size: local shard_id=1 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:235: rados_get_data_bad_size: shift 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: local bytes=256 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:237: rados_get_data_bad_size: shift 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: local mode=add 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:240: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: local objname=obj-size-72120-1-256 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-72120-1-256 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-72120-1-256 2026-02-13T05:59:01.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:59:01.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:59:01.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:59:01.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:59:01.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:59:01.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:59:01.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:59:01.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:59:01.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-72120-1-256 td/test-erasure-eio/ORIGINAL 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:246: rados_get_data_bad_size: set_size obj-size-72120-1-256 td/test-erasure-eio 1 256 add 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72120-1-256 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=1 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=256 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=add 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72120-1-256 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:59:01.898 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72120-1-256 2026-02-13T05:59:01.899 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72120-1-256 2026-02-13T05:59:01.899 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:59:02.132 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:59:02.132 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:02.132 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:59:02.132 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:59:02.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-13T05:59:02.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-13T05:59:02.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=1 2026-02-13T05:59:02.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-13T05:59:02.412 INFO:tasks.workunit.client.0.trial024.stderr:noout is set 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' add = add ']' 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72120-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72120-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:59:02.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:59:02.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:59:02.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:59:02.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:59:02.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72120-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:02.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:59:02.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:59:02.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T05:59:02.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:59:02.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-13T05:59:02.731 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72120-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:02.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-13T05:59:02.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:59:02.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:59:02.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T05:59:02.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:59:02.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:59:02.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:59:02.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:59:02.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:59:02.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:59:02.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:59:02.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:59:02.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:59:02.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:59:02.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:59:02.823 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:59:02.823 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:02.823 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:02.823 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:02.823 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:02.823 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:02.823 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:02.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:02.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:59:02.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:59:02.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:59:02.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:59:02.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:59:02.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:59:02.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:59:02.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:59:02.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:59:02.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:59:02.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T05:59:02.824 INFO:tasks.workunit.client.0.trial024.stderr:start osd.1 2026-02-13T05:59:02.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:59:02.824 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-13T05:59:02.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T05:59:02.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:59:02.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:59:02.825 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:59:02.838 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:02.836+0000 7fe975140900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:02.839 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:02.837+0000 7fe975140900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:02.840 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:02.838+0000 7fe975140900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:02.964 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:02.963+0000 7fe975140900 -1 Falling back to public interface 2026-02-13T05:59:03.043 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T05:59:03.043 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:59:03.043 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:59:03.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:59:03.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:59:03.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:03.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:59:03.044 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:59:03.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:03.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:59:03.263 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:03.261+0000 7fe975140900 -1 osd.1 71 log_to_monitors true 2026-02-13T05:59:03.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:59:04.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:59:04.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:04.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:59:04.272 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:04.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:04.272 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:59:04.494 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 up in weight 1 up_from 76 up_thru 76 down_at 73 last_clean_interval [58,71) [v2:127.0.0.1:6810/3877181082,v1:127.0.0.1:6811/3877181082] [v2:127.0.0.1:6812/3877181082,v1:127.0.0.1:6813/3877181082] exists,up 543fd345-711c-4266-bbd5-4f4eac39a0d4 2026-02-13T05:59:04.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:59:04.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:59:04.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:59:04.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:59:04.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:59:04.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:59:04.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:59:04.495 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:59:04.496 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:59:04.496 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:59:04.496 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:59:04.496 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:59:04.496 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:59:04.581 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:59:04.581 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:59:04.581 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:59:04.581 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:59:04.581 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:59:04.582 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:59:04.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:59:04.805 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:04.805 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:59:04.805 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:59:04.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:59:04.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:04.805 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:59:04.870 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803797 2026-02-13T05:59:04.871 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803797 2026-02-13T05:59:04.871 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803797' 2026-02-13T05:59:04.871 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:04.871 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:59:04.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=326417514499 2026-02-13T05:59:04.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 326417514499 2026-02-13T05:59:04.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803797 1-326417514499' 2026-02-13T05:59:04.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:04.937 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:59:05.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808838 2026-02-13T05:59:05.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808838 2026-02-13T05:59:05.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803797 1-326417514499 2-287762808838' 2026-02-13T05:59:05.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:05.001 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:59:05.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149716 2026-02-13T05:59:05.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149716 2026-02-13T05:59:05.063 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803797 1-326417514499 2-287762808838 3-111669149716' 2026-02-13T05:59:05.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:05.064 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803797 2026-02-13T05:59:05.064 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:05.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:59:05.065 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803797 2026-02-13T05:59:05.066 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:05.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803797 2026-02-13T05:59:05.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803797' 2026-02-13T05:59:05.067 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803797 2026-02-13T05:59:05.067 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:59:05.290 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803795 -lt 25769803797 2026-02-13T05:59:05.290 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:59:06.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:59:06.292 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:59:06.520 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803797 -lt 25769803797 2026-02-13T05:59:06.520 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:06.520 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-326417514499 2026-02-13T05:59:06.521 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:06.521 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:59:06.522 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-326417514499 2026-02-13T05:59:06.522 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:06.523 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=326417514499 2026-02-13T05:59:06.524 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 326417514499' 2026-02-13T05:59:06.524 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 326417514499 2026-02-13T05:59:06.524 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:59:06.750 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 326417514499 -lt 326417514499 2026-02-13T05:59:06.750 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:06.750 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-287762808838 2026-02-13T05:59:06.750 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:06.751 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:59:06.752 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-287762808838 2026-02-13T05:59:06.752 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:06.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808838 2026-02-13T05:59:06.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 287762808838' 2026-02-13T05:59:06.753 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 287762808838 2026-02-13T05:59:06.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:59:06.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808838 -lt 287762808838 2026-02-13T05:59:06.977 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:06.978 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149716 2026-02-13T05:59:06.978 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:06.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:59:06.979 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149716 2026-02-13T05:59:06.979 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:06.980 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149716 2026-02-13T05:59:06.981 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149716' 2026-02-13T05:59:06.981 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 111669149716 2026-02-13T05:59:06.981 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:59:07.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149717 -lt 111669149716 2026-02-13T05:59:07.208 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:59:07.208 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:59:07.209 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:59:07.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:59:07.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:59:07.529 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:59:07.529 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:59:07.529 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:59:07.529 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:59:07.529 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:59:07.529 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:59:07.759 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:59:07.759 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:59:07.760 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:59:07.760 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:59:08.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:59:08.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:59:08.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:59:08.075 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:219: set_size: dd if=/dev/urandom bs=256 count=1 2026-02-13T05:59:08.077 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records in 2026-02-13T05:59:08.077 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records out 2026-02-13T05:59:08.077 INFO:tasks.workunit.client.0.trial024.stderr:256 bytes copied, 2.0458e-05 s, 12.5 MB/s 2026-02-13T05:59:08.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-72120-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:08.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:59:08.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:59:08.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-13T05:59:08.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:59:08.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-72120-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:08.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:59:08.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:59:08.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-13T05:59:08.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:59:08.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-13T05:59:08.078 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:59:08.078 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:59:08.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:59:08.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:59:08.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:59:08.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:59:08.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-72120-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:08.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:59:08.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:59:08.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T05:59:08.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:59:08.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-13T05:59:08.184 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-72120-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:08.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-13T05:59:08.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:59:08.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:59:08.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T05:59:08.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:59:08.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:59:08.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:59:08.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:59:08.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:59:08.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:59:08.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:59:08.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:59:08.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:59:08.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:59:08.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:59:08.329 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:59:08.329 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:08.329 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:08.329 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:08.329 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:59:08.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:59:08.331 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T05:59:08.331 INFO:tasks.workunit.client.0.trial024.stderr:start osd.1 2026-02-13T05:59:08.331 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:59:08.331 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-13T05:59:08.332 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T05:59:08.332 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:59:08.332 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:59:08.332 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:59:08.344 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:08.342+0000 7f49b017d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:08.345 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:08.344+0000 7f49b017d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:08.346 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:08.345+0000 7f49b017d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:08.499 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:08.497+0000 7f49b017d900 -1 Falling back to public interface 2026-02-13T05:59:08.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T05:59:08.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:59:08.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:59:08.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:59:08.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:59:08.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:08.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:59:08.552 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:59:08.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:08.553 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:59:08.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:59:08.809 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:08.807+0000 7f49b017d900 -1 osd.1 77 log_to_monitors true 2026-02-13T05:59:09.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:59:09.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:09.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:59:09.777 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:09.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:09.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:59:10.003 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 up in weight 1 up_from 81 up_thru 81 down_at 78 last_clean_interval [76,77) [v2:127.0.0.1:6810/746292252,v1:127.0.0.1:6811/746292252] [v2:127.0.0.1:6812/746292252,v1:127.0.0.1:6813/746292252] exists,up 543fd345-711c-4266-bbd5-4f4eac39a0d4 2026-02-13T05:59:10.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:59:10.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:59:10.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:59:10.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:59:10.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:59:10.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:59:10.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:59:10.004 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:59:10.005 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:59:10.005 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:59:10.005 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:59:10.005 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:59:10.005 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:59:10.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:59:10.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:59:10.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:59:10.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:59:10.091 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:59:10.091 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:59:10.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:59:10.314 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:10.314 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:59:10.314 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:59:10.315 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:59:10.315 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:10.315 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:59:10.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803800 2026-02-13T05:59:10.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803800 2026-02-13T05:59:10.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803800' 2026-02-13T05:59:10.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:10.379 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:59:10.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=347892350979 2026-02-13T05:59:10.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 347892350979 2026-02-13T05:59:10.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803800 1-347892350979' 2026-02-13T05:59:10.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:10.445 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:59:10.507 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808841 2026-02-13T05:59:10.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808841 2026-02-13T05:59:10.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803800 1-347892350979 2-287762808841' 2026-02-13T05:59:10.508 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:10.508 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:59:10.571 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149720 2026-02-13T05:59:10.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149720 2026-02-13T05:59:10.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803800 1-347892350979 2-287762808841 3-111669149720' 2026-02-13T05:59:10.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:10.572 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803800 2026-02-13T05:59:10.572 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:10.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:59:10.574 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803800 2026-02-13T05:59:10.574 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:10.575 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803800 2026-02-13T05:59:10.575 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803800' 2026-02-13T05:59:10.575 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803800 2026-02-13T05:59:10.576 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:59:10.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803798 -lt 25769803800 2026-02-13T05:59:10.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:59:11.801 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:59:11.801 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:59:12.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803800 -lt 25769803800 2026-02-13T05:59:12.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:12.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-347892350979 2026-02-13T05:59:12.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:12.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:59:12.028 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-347892350979 2026-02-13T05:59:12.028 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:12.029 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=347892350979 2026-02-13T05:59:12.029 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 347892350979' 2026-02-13T05:59:12.029 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 347892350979 2026-02-13T05:59:12.029 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:59:12.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350979 -lt 347892350979 2026-02-13T05:59:12.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:12.252 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-287762808841 2026-02-13T05:59:12.253 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:12.254 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:59:12.254 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-287762808841 2026-02-13T05:59:12.254 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:12.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=287762808841 2026-02-13T05:59:12.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 287762808841' 2026-02-13T05:59:12.256 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 287762808841 2026-02-13T05:59:12.256 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:59:12.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 287762808841 -lt 287762808841 2026-02-13T05:59:12.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:12.478 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149720 2026-02-13T05:59:12.478 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:12.479 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:59:12.479 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149720 2026-02-13T05:59:12.480 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:12.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149720 2026-02-13T05:59:12.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149720' 2026-02-13T05:59:12.481 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 111669149720 2026-02-13T05:59:12.481 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:59:12.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149720 -lt 111669149720 2026-02-13T05:59:12.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:59:12.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:59:12.706 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:59:13.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:59:13.025 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:59:13.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:59:13.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:59:13.026 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:59:13.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:59:13.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:59:13.027 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:59:13.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:59:13.246 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:59:13.247 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:59:13.247 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:59:13.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:59:13.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:59:13.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:59:13.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-13T05:59:13.555 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-13T05:59:13.868 INFO:tasks.workunit.client.0.trial024.stderr:noout is unset 2026-02-13T05:59:13.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:248: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72120-1-256 2026-02-13T05:59:13.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:59:13.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:59:13.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72120-1-256 2026-02-13T05:59:13.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:59:13.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:59:13.877 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72120-1-256 td/test-erasure-eio/COPY 2026-02-13T05:59:13.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:59:13.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:59:13.899 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: expr 1 + 1 2026-02-13T05:59:13.901 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:251: rados_get_data_bad_size: local another_shard_id=2 2026-02-13T05:59:13.901 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:252: rados_get_data_bad_size: set_size obj-size-72120-1-256 td/test-erasure-eio 2 256 add 2026-02-13T05:59:13.901 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local objname=obj-size-72120-1-256 2026-02-13T05:59:13.901 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: shift 2026-02-13T05:59:13.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local dir=td/test-erasure-eio 2026-02-13T05:59:13.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: shift 2026-02-13T05:59:13.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: local shard_id=2 2026-02-13T05:59:13.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:207: set_size: shift 2026-02-13T05:59:13.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: local bytes=256 2026-02-13T05:59:13.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: shift 2026-02-13T05:59:13.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: local mode=add 2026-02-13T05:59:13.902 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: local poolname=pool-jerasure 2026-02-13T05:59:13.902 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: get_osds pool-jerasure obj-size-72120-1-256 2026-02-13T05:59:13.902 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:59:13.902 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-size-72120-1-256 2026-02-13T05:59:13.902 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-size-72120-1-256 2026-02-13T05:59:13.903 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:59:14.125 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:59:14.125 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:14.125 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:59:14.125 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:59:14.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: initial_osds=('3' '1' '2') 2026-02-13T05:59:14.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:213: set_size: local -a initial_osds 2026-02-13T05:59:14.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: local osd_id=2 2026-02-13T05:59:14.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:215: set_size: ceph osd set noout 2026-02-13T05:59:14.473 INFO:tasks.workunit.client.0.trial024.stderr:noout is set 2026-02-13T05:59:14.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: '[' add = add ']' 2026-02-13T05:59:14.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: objectstore_tool td/test-erasure-eio 2 obj-size-72120-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:14.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:59:14.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:59:14.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-13T05:59:14.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:59:14.483 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-size-72120-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:14.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:59:14.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:59:14.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-13T05:59:14.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:59:14.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-13T05:59:14.484 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:59:14.484 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:59:14.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:59:14.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:59:14.484 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:59:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:59:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-size-72120-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:59:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:59:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-13T05:59:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:59:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-13T05:59:14.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-size-72120-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:14.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-13T05:59:14.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:59:14.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:59:14.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T05:59:14.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:59:14.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:59:14.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:59:14.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:59:14.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:59:14.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:59:14.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:59:14.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:59:14.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:59:14.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:59:14.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:59:14.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:59:14.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:14.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:14.880 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:14.880 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:14.880 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:14.880 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:14.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:14.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:59:14.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:59:14.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:59:14.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:59:14.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:59:14.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:59:14.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:59:14.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:59:14.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:59:14.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:59:14.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T05:59:14.881 INFO:tasks.workunit.client.0.trial024.stderr:start osd.2 2026-02-13T05:59:14.881 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:59:14.881 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-13T05:59:14.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T05:59:14.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:59:14.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:59:14.882 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:59:14.894 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:14.893+0000 7f40d7722900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:14.895 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:14.895+0000 7f40d7722900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:14.896 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:14.896+0000 7f40d7722900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:15.048 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:15.047+0000 7f40d7722900 -1 Falling back to public interface 2026-02-13T05:59:15.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T05:59:15.104 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:59:15.104 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:59:15.104 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:59:15.104 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:59:15.104 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:15.104 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:59:15.104 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:59:15.104 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:15.104 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:59:15.329 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:59:15.426 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:15.425+0000 7f40d7722900 -1 osd.2 85 log_to_monitors true 2026-02-13T05:59:16.331 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:59:16.331 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:16.332 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:59:16.332 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:16.332 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:16.332 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:59:16.558 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 up in weight 1 up_from 90 up_thru 78 down_at 87 last_clean_interval [67,85) [v2:127.0.0.1:6818/315581364,v1:127.0.0.1:6819/315581364] [v2:127.0.0.1:6820/315581364,v1:127.0.0.1:6821/315581364] exists,up 105b8e77-2fa7-4465-8106-0a12b53c1527 2026-02-13T05:59:16.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:59:16.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:59:16.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:59:16.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:59:16.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:59:16.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:59:16.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:59:16.559 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:59:16.560 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:59:16.560 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:59:16.560 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:59:16.560 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:59:16.561 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:59:16.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:59:16.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:59:16.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:59:16.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:59:16.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:59:16.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:59:16.878 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:59:16.878 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:16.879 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:59:16.879 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:59:16.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:59:16.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:16.879 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:59:16.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803803 2026-02-13T05:59:16.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803803 2026-02-13T05:59:16.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803803' 2026-02-13T05:59:16.943 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:16.943 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:59:17.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=347892350982 2026-02-13T05:59:17.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 347892350982 2026-02-13T05:59:17.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803803 1-347892350982' 2026-02-13T05:59:17.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:17.007 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:59:17.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056643 2026-02-13T05:59:17.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056643 2026-02-13T05:59:17.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803803 1-347892350982 2-386547056643' 2026-02-13T05:59:17.072 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:17.072 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:59:17.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149723 2026-02-13T05:59:17.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149723 2026-02-13T05:59:17.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803803 1-347892350982 2-386547056643 3-111669149723' 2026-02-13T05:59:17.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:17.136 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803803 2026-02-13T05:59:17.136 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:17.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:59:17.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803803 2026-02-13T05:59:17.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:17.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803803 2026-02-13T05:59:17.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803803' 2026-02-13T05:59:17.138 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803803 2026-02-13T05:59:17.139 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:59:17.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803803 -lt 25769803803 2026-02-13T05:59:17.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:17.374 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-347892350982 2026-02-13T05:59:17.374 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:17.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:59:17.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-347892350982 2026-02-13T05:59:17.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:17.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=347892350982 2026-02-13T05:59:17.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 347892350982' 2026-02-13T05:59:17.377 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 347892350982 2026-02-13T05:59:17.377 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:59:17.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350982 -lt 347892350982 2026-02-13T05:59:17.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:17.603 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-386547056643 2026-02-13T05:59:17.603 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:17.604 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:59:17.605 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-386547056643 2026-02-13T05:59:17.605 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:17.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=386547056643 2026-02-13T05:59:17.606 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 386547056643' 2026-02-13T05:59:17.606 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 386547056643 2026-02-13T05:59:17.607 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:59:17.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 386547056643 -lt 386547056643 2026-02-13T05:59:17.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:17.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149723 2026-02-13T05:59:17.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:17.833 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:59:17.834 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149723 2026-02-13T05:59:17.834 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:17.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149723 2026-02-13T05:59:17.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149723' 2026-02-13T05:59:17.835 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 111669149723 2026-02-13T05:59:17.835 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:59:18.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149723 -lt 111669149723 2026-02-13T05:59:18.065 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:59:18.066 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:59:18.066 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:59:18.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:59:18.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:59:18.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:59:18.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:59:18.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:59:18.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:59:18.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:59:18.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:59:18.603 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:59:18.604 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:59:18.604 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:59:18.604 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:59:18.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:59:18.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:59:18.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:59:18.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:219: set_size: dd if=/dev/urandom bs=256 count=1 2026-02-13T05:59:18.921 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records in 2026-02-13T05:59:18.921 INFO:tasks.workunit.client.0.trial024.stderr:1+0 records out 2026-02-13T05:59:18.921 INFO:tasks.workunit.client.0.trial024.stderr:256 bytes copied, 1.9827e-05 s, 12.9 MB/s 2026-02-13T05:59:18.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: set_size: objectstore_tool td/test-erasure-eio 2 obj-size-72120-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:18.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T05:59:18.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T05:59:18.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-13T05:59:18.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T05:59:18.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-size-72120-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:18.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T05:59:18.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T05:59:18.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-13T05:59:18.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T05:59:18.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-13T05:59:18.923 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:59:18.923 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:59:18.923 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:59:18.923 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:59:18.923 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:59:19.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:59:19.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-size-72120-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:19.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T05:59:19.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T05:59:19.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-13T05:59:19.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T05:59:19.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-13T05:59:19.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-size-72120-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-13T05:59:19.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-13T05:59:19.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T05:59:19.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T05:59:19.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T05:59:19.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T05:59:19.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:59:19.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:59:19.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:59:19.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:59:19.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:59:19.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:59:19.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:59:19.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T05:59:19.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T05:59:19.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:59:19.170 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T05:59:19.170 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:19.170 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:19.170 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:19.170 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:19.170 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:19.170 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:19.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:19.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:59:19.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:59:19.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:59:19.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:59:19.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:59:19.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:59:19.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:59:19.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T05:59:19.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T05:59:19.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:59:19.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T05:59:19.171 INFO:tasks.workunit.client.0.trial024.stderr:start osd.2 2026-02-13T05:59:19.171 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:59:19.171 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-13T05:59:19.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T05:59:19.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T05:59:19.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T05:59:19.173 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T05:59:19.184 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:19.183+0000 7f9c10597900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:19.185 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:19.185+0000 7f9c10597900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:19.186 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:19.186+0000 7f9c10597900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:19.337 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:19.336+0000 7f9c10597900 -1 Falling back to public interface 2026-02-13T05:59:19.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T05:59:19.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:59:19.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:59:19.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:59:19.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:59:19.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:19.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:59:19.397 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T05:59:19.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:19.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:59:19.621 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:19.620+0000 7f9c10597900 -1 osd.2 91 log_to_monitors true 2026-02-13T05:59:19.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:59:20.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:59:20.625 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:20.625 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:59:20.625 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:20.625 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:20.625 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:59:20.846 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 up in weight 1 up_from 95 up_thru 78 down_at 92 last_clean_interval [90,91) [v2:127.0.0.1:6818/3771340240,v1:127.0.0.1:6819/3771340240] [v2:127.0.0.1:6820/3771340240,v1:127.0.0.1:6821/3771340240] exists,up 105b8e77-2fa7-4465-8106-0a12b53c1527 2026-02-13T05:59:20.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:59:20.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:59:20.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:59:20.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T05:59:20.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:59:20.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:59:20.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:59:20.846 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:59:20.847 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:59:20.847 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:59:20.847 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:59:20.847 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:59:20.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:59:20.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:59:20.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:59:20.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:59:20.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:59:20.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:59:20.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:59:21.157 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:59:21.157 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:21.157 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:59:21.157 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:59:21.157 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:59:21.158 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:21.158 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:59:21.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803806 2026-02-13T05:59:21.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803806 2026-02-13T05:59:21.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803806' 2026-02-13T05:59:21.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:21.223 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:59:21.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=347892350985 2026-02-13T05:59:21.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 347892350985 2026-02-13T05:59:21.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803806 1-347892350985' 2026-02-13T05:59:21.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:21.287 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:59:21.352 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=408021893123 2026-02-13T05:59:21.352 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 408021893123 2026-02-13T05:59:21.352 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803806 1-347892350985 2-408021893123' 2026-02-13T05:59:21.352 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:21.352 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:59:21.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149726 2026-02-13T05:59:21.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149726 2026-02-13T05:59:21.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803806 1-347892350985 2-408021893123 3-111669149726' 2026-02-13T05:59:21.416 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:21.416 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803806 2026-02-13T05:59:21.417 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:21.417 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:59:21.418 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803806 2026-02-13T05:59:21.418 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:21.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803806 2026-02-13T05:59:21.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803806' 2026-02-13T05:59:21.419 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803806 2026-02-13T05:59:21.419 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:59:21.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803806 -lt 25769803806 2026-02-13T05:59:21.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:21.646 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-347892350985 2026-02-13T05:59:21.647 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:21.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:59:21.648 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-347892350985 2026-02-13T05:59:21.648 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:21.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=347892350985 2026-02-13T05:59:21.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 347892350985' 2026-02-13T05:59:21.649 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 347892350985 2026-02-13T05:59:21.650 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:59:21.884 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350984 -lt 347892350985 2026-02-13T05:59:21.884 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:59:22.884 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:59:22.885 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:59:23.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350984 -lt 347892350985 2026-02-13T05:59:23.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:59:24.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T05:59:24.113 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:59:24.340 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350985 -lt 347892350985 2026-02-13T05:59:24.340 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:24.341 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-408021893123 2026-02-13T05:59:24.341 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:24.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:59:24.343 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-408021893123 2026-02-13T05:59:24.343 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:24.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=408021893123 2026-02-13T05:59:24.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 408021893123' 2026-02-13T05:59:24.344 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 408021893123 2026-02-13T05:59:24.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:59:24.569 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 408021893123 -lt 408021893123 2026-02-13T05:59:24.570 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:24.570 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149726 2026-02-13T05:59:24.570 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:24.571 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:59:24.572 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149726 2026-02-13T05:59:24.572 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:24.573 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149726 2026-02-13T05:59:24.574 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149726' 2026-02-13T05:59:24.574 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 111669149726 2026-02-13T05:59:24.574 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:59:24.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149726 -lt 111669149726 2026-02-13T05:59:24.797 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:59:24.798 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:59:24.798 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:59:25.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:59:25.118 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:59:25.118 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:59:25.119 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:59:25.119 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:59:25.119 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:59:25.119 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:59:25.119 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:59:25.341 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:59:25.342 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:59:25.342 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:59:25.342 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:59:25.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:59:25.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:59:25.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:59:25.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-13T05:59:25.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: set_size: ceph osd unset noout 2026-02-13T05:59:25.980 INFO:tasks.workunit.client.0.trial024.stderr:noout is unset 2026-02-13T05:59:25.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:253: rados_get_data_bad_size: '[' 1 -eq 1 -a 2 -eq 2 ']' 2026-02-13T05:59:25.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:258: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-72120-1-256 2026-02-13T05:59:25.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:59:25.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:59:25.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-72120-1-256 2026-02-13T05:59:25.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:59:25.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:59:25.993 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-72120-1-256 td/test-erasure-eio/COPY 2026-02-13T05:59:26.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:59:26.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:59:26.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:264: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-13T05:59:26.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:346: TEST_rados_get_bad_size_shard_1: delete_erasure_coded_pool pool-jerasure 2026-02-13T05:59:26.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:59:26.015 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T05:59:26.244 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T05:59:26.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T05:59:26.526 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T05:59:26.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T05:59:26.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:59:26.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:59:26.535 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:59:26.535 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:59:26.535 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:59:26.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:59:26.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:59:26.536 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:59:26.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:59:26.643 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:59:26.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:59:26.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:59:26.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:59:26.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:59:26.647 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:59:26.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:59:26.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:59:26.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:59:26.648 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:59:26.649 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:59:26.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:59:26.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:59:26.665 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:59:26.666 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:26.666 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:26.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:59:26.668 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:59:26.668 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:59:26.668 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T05:59:26.668 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T05:59:26.668 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T05:59:26.668 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T05:59:26.668 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:59:26.668 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:59:26.668 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:59:26.669 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:59:26.669 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:59:26.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:59:26.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:59:26.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:59:26.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:59:26.670 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:59:26.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:59:26.670 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:59:26.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:59:26.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:59:26.672 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:59:26.672 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:59:26.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:59:26.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:59:26.673 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:59:26.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:59:26.675 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:59:26.675 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:59:26.676 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:59:26.676 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:26.676 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:26.676 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:59:26.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:59:26.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:59:26.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T05:59:26.678 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:59:26.679 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:26.679 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:26.679 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T05:59:26.680 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:59:26.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:59:26.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:59:26.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T05:59:26.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T05:59:26.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T05:59:26.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:59:26.681 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:59:26.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:59:26.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T05:59:26.682 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T05:59:26.701 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:59:26.701 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:26.701 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:26.701 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:26.701 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:26.701 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:26.701 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:26.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:59:26.728 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:59:26.728 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:59:26.728 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:59:26.729 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:59:26.729 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:59:26.729 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:59:26.729 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:59:26.729 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:59:26.729 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:59:26.730 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:59:26.730 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:26.730 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:26.730 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:59:26.730 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:59:26.730 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T05:59:26.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:59:26.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:59:26.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:59:26.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:59:26.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:59:26.777 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:59:26.777 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:59:26.777 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:59:26.777 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:59:26.777 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:26.777 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:26.777 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:59:26.777 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:59:26.777 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T05:59:26.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T05:59:26.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T05:59:26.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:59:26.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:59:26.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:59:26.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T05:59:26.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:59:26.921 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:59:26.922 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:26.922 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:26.922 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:26.922 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:26.922 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:26.922 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:26.923 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:59:26.923 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:59:26.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T05:59:26.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:59:27.038 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:59:27.045 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:59:28.048 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T05:59:28.048 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:59:28.048 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:59:28.048 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:59:28.048 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:28.048 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:28.048 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:59:28.048 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T05:59:28.049 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T05:59:28.090 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:59:28.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T05:59:28.096 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:59:26.720+0000 7f5dbdcc6d80 0 load: jerasure load: lrc 2026-02-13T05:59:28.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_subread_eio_shard_0 td/test-erasure-eio 2026-02-13T05:59:28.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:275: TEST_rados_get_subread_eio_shard_0: local dir=td/test-erasure-eio 2026-02-13T05:59:28.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:276: TEST_rados_get_subread_eio_shard_0: setup_osds 4 2026-02-13T05:59:28.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-13T05:59:28.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T05:59:28.098 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:59:28.102 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7405336b-c2b4-4599-82a3-18e5a22fd2c2 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 7405336b-c2b4-4599-82a3-18e5a22fd2c2' 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 7405336b-c2b4-4599-82a3-18e5a22fd2c2 2026-02-13T05:59:28.103 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:59:28.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDAvY5pEUrFBhAAvRHyvGQPF6g3XHkTBZNN/Q== 2026-02-13T05:59:28.114 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDAvY5pEUrFBhAAvRHyvGQPF6g3XHkTBZNN/Q=="}' 2026-02-13T05:59:28.115 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7405336b-c2b4-4599-82a3-18e5a22fd2c2 -i td/test-erasure-eio/0/new.json 2026-02-13T05:59:28.217 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:59:28.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T05:59:28.224 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDAvY5pEUrFBhAAvRHyvGQPF6g3XHkTBZNN/Q== --osd-uuid 7405336b-c2b4-4599-82a3-18e5a22fd2c2 2026-02-13T05:59:28.242 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:28.241+0000 7fb3b7d29900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:28.243 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:28.242+0000 7fb3b7d29900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:28.244 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:28.243+0000 7fb3b7d29900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:28.244 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:28.243+0000 7fb3b7d29900 -1 bdev(0x562efcf9ec00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:59:28.244 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:28.244+0000 7fb3b7d29900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T05:59:28.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T05:59:28.657 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:59:28.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:59:28.658 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:59:28.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:59:28.761 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:59:28.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:59:28.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:59:28.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:59:28.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:59:28.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:59:28.778 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:28.777+0000 7feb6eea1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:28.779 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:28.779+0000 7feb6eea1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:28.780 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:28.779+0000 7feb6eea1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:28.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:59:28.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:59:28.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:59:28.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:59:28.860 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:59:28.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:28.861 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:59:28.861 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:59:28.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:28.862 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:59:28.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:59:28.992 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:28.991+0000 7feb6eea1900 -1 Falling back to public interface 2026-02-13T05:59:29.252 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:29.252+0000 7feb6eea1900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:59:29.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:59:29.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:29.959 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:59:29.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:59:29.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:29.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:59:30.192 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1493224977,v1:127.0.0.1:6803/1493224977] [v2:127.0.0.1:6804/1493224977,v1:127.0.0.1:6805/1493224977] exists,up 7405336b-c2b4-4599-82a3-18e5a22fd2c2 2026-02-13T05:59:30.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:59:30.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:59:30.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:59:30.197 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:59:30.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T05:59:30.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:59:30.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:59:30.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:59:30.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:59:30.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:59:30.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:59:30.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:59:30.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:59:30.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:59:30.198 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:59:30.199 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:59:30.199 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:59:30.199 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:59:30.199 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:59:30.199 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:59:30.199 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:30.199 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:30.199 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:30.199 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:30.199 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:30.199 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:30.199 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:59:30.200 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:59:30.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7a7a6af3-a627-4dcd-b2dc-0e21f4a02cf5 2026-02-13T05:59:30.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 7a7a6af3-a627-4dcd-b2dc-0e21f4a02cf5' 2026-02-13T05:59:30.201 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 7a7a6af3-a627-4dcd-b2dc-0e21f4a02cf5 2026-02-13T05:59:30.201 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:59:30.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDCvY5p+XReDBAA2/dtgV2h96+A64CQbS61FQ== 2026-02-13T05:59:30.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDCvY5p+XReDBAA2/dtgV2h96+A64CQbS61FQ=="}' 2026-02-13T05:59:30.209 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7a7a6af3-a627-4dcd-b2dc-0e21f4a02cf5 -i td/test-erasure-eio/1/new.json 2026-02-13T05:59:30.443 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:59:30.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T05:59:30.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDCvY5p+XReDBAA2/dtgV2h96+A64CQbS61FQ== --osd-uuid 7a7a6af3-a627-4dcd-b2dc-0e21f4a02cf5 2026-02-13T05:59:30.470 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:30.469+0000 7fb9d4ef3900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:30.471 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:30.471+0000 7fb9d4ef3900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:30.472 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:30.472+0000 7fb9d4ef3900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:30.473 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:30.472+0000 7fb9d4ef3900 -1 bdev(0x564196800c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:59:30.473 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:30.472+0000 7fb9d4ef3900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T05:59:30.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T05:59:30.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:59:30.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:59:30.797 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:59:30.797 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:59:31.109 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:59:31.110 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:59:31.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:59:31.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:59:31.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:59:31.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:59:31.127 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:31.126+0000 7fb1b9b88900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:31.128 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:31.128+0000 7fb1b9b88900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:31.129 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:31.128+0000 7fb1b9b88900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:31.312 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:31.312+0000 7fb1b9b88900 -1 Falling back to public interface 2026-02-13T05:59:31.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:59:31.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:59:31.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:59:31.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:59:31.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:59:31.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:31.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:59:31.336 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:59:31.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:31.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:59:31.559 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:59:31.646 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:31.645+0000 7fb1b9b88900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:59:32.561 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:59:32.561 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:32.561 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:59:32.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:59:32.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:32.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:59:32.783 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4043211312,v1:127.0.0.1:6811/4043211312] [v2:127.0.0.1:6812/4043211312,v1:127.0.0.1:6813/4043211312] exists,up 7a7a6af3-a627-4dcd-b2dc-0e21f4a02cf5 2026-02-13T05:59:32.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:59:32.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:59:32.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:59:32.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:59:32.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T05:59:32.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:59:32.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:59:32.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:59:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:59:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:59:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:59:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:59:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:59:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:59:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:59:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:59:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:59:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:59:32.789 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:59:32.790 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:59:32.790 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:32.790 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:32.790 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:32.790 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:32.790 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:32.790 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:32.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:32.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:59:32.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:59:32.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:59:32.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:59:32.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:59:32.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:59:32.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:59:32.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:59:32.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:59:32.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:59:32.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:59:32.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:59:32.791 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:59:32.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=45acde47-d3cf-4539-b349-690dc3a106d6 2026-02-13T05:59:32.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 45acde47-d3cf-4539-b349-690dc3a106d6' 2026-02-13T05:59:32.792 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 45acde47-d3cf-4539-b349-690dc3a106d6 2026-02-13T05:59:32.792 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:59:32.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDEvY5pzB+fLxAANZQnlL0HykGI9JuAUIWMFQ== 2026-02-13T05:59:32.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDEvY5pzB+fLxAANZQnlL0HykGI9JuAUIWMFQ=="}' 2026-02-13T05:59:32.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 45acde47-d3cf-4539-b349-690dc3a106d6 -i td/test-erasure-eio/2/new.json 2026-02-13T05:59:33.026 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:59:33.033 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T05:59:33.035 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDEvY5pzB+fLxAANZQnlL0HykGI9JuAUIWMFQ== --osd-uuid 45acde47-d3cf-4539-b349-690dc3a106d6 2026-02-13T05:59:33.052 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:33.052+0000 7f3294816900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:33.053 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:33.053+0000 7f3294816900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:33.054 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:33.054+0000 7f3294816900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:33.055 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:33.054+0000 7f3294816900 -1 bdev(0x556623730c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:59:33.055 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:33.054+0000 7f3294816900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T05:59:33.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T05:59:33.476 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:59:33.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:59:33.478 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:59:33.478 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:59:33.693 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:59:33.693 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:59:33.694 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:59:33.694 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:59:33.694 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:59:33.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:59:33.715 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:33.715+0000 7f8bfa083900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:33.717 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:33.716+0000 7f8bfa083900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:33.718 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:33.717+0000 7f8bfa083900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:33.848 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:33.848+0000 7f8bfa083900 -1 Falling back to public interface 2026-02-13T05:59:33.920 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:59:33.920 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:59:33.920 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:59:33.921 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:59:33.921 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:59:33.921 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:33.921 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:59:33.921 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:59:33.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:33.922 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:59:34.142 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:59:34.171 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:34.170+0000 7f8bfa083900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:59:35.143 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:59:35.143 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:35.144 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:59:35.145 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:59:35.145 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:35.145 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:59:35.369 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 17 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/418565299,v1:127.0.0.1:6819/418565299] [v2:127.0.0.1:6820/418565299,v1:127.0.0.1:6821/418565299] exists,up 45acde47-d3cf-4539-b349-690dc3a106d6 2026-02-13T05:59:35.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:59:35.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:59:35.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:59:35.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:59:35.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T05:59:35.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:59:35.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:59:35.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T05:59:35.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:59:35.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:59:35.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:59:35.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:59:35.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:59:35.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:59:35.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:59:35.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:59:35.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:59:35.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:59:35.375 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:59:35.375 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:59:35.375 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:59:35.376 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:59:35.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:59:35.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:59:35.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:59:35.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:59:35.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:59:35.377 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:59:35.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=139088ec-08d2-48e8-ba97-310530082ee8 2026-02-13T05:59:35.377 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 139088ec-08d2-48e8-ba97-310530082ee8' 2026-02-13T05:59:35.377 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 139088ec-08d2-48e8-ba97-310530082ee8 2026-02-13T05:59:35.378 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:59:35.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDHvY5pyO3qFhAALWUSCkb7OhfGgTlfSFTYlg== 2026-02-13T05:59:35.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDHvY5pyO3qFhAALWUSCkb7OhfGgTlfSFTYlg=="}' 2026-02-13T05:59:35.385 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 139088ec-08d2-48e8-ba97-310530082ee8 -i td/test-erasure-eio/3/new.json 2026-02-13T05:59:35.614 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T05:59:35.622 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T05:59:35.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDHvY5pyO3qFhAALWUSCkb7OhfGgTlfSFTYlg== --osd-uuid 139088ec-08d2-48e8-ba97-310530082ee8 2026-02-13T05:59:35.641 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:35.640+0000 7f4e63010900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:35.642 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:35.642+0000 7f4e63010900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:35.643 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:35.643+0000 7f4e63010900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:35.644 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:35.643+0000 7f4e63010900 -1 bdev(0x559507006c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T05:59:35.644 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:35.643+0000 7f4e63010900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T05:59:35.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T05:59:35.966 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:59:35.967 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T05:59:35.967 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T05:59:35.967 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:59:36.283 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T05:59:36.283 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:59:36.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:59:36.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:59:36.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:59:36.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:59:36.302 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:36.301+0000 7f4822822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:36.303 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:36.302+0000 7f4822822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:36.304 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:36.303+0000 7f4822822900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:36.443 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:36.442+0000 7f4822822900 -1 Falling back to public interface 2026-02-13T05:59:36.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T05:59:36.518 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:59:36.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:59:36.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:59:36.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:59:36.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:36.519 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:59:36.519 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:59:36.520 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:36.520 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:59:36.743 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:59:36.775 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:36.774+0000 7f4822822900 -1 osd.3 0 log_to_monitors true 2026-02-13T05:59:37.744 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:59:37.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:37.745 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:59:37.745 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:59:37.746 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:37.746 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:59:37.967 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 24 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1398699830,v1:127.0.0.1:6827/1398699830] [v2:127.0.0.1:6828/1398699830,v1:127.0.0.1:6829/1398699830] exists,up 139088ec-08d2-48e8-ba97-310530082ee8 2026-02-13T05:59:37.968 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:59:37.968 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:59:37.968 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:59:37.968 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T05:59:37.968 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:59:37.968 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:59:37.969 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:59:37.969 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:37.969 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:37.970 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:59:37.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T05:59:37.970 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T05:59:38.015 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:59:38.019 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T05:59:38.021 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:59:28.994+0000 7feb6eea1900 0 load: jerasure load: lrc 2026-02-13T05:59:38.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:278: TEST_rados_get_subread_eio_shard_0: local poolname=pool-jerasure 2026-02-13T05:59:38.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:279: TEST_rados_get_subread_eio_shard_0: create_erasure_coded_pool pool-jerasure 2 1 2026-02-13T05:59:38.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:59:38.022 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T05:59:38.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-13T05:59:38.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T05:59:38.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-13T05:59:38.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T05:59:38.023 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-13T05:59:38.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T05:59:38.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T05:59:38.678 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T05:59:38.686 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:59:39.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T05:59:39.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:59:39.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:59:39.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:59:39.689 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:59:39.690 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:59:39.690 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:59:39.690 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:59:39.690 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:59:39.690 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:59:39.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:59:39.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:59:39.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:59:39.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:59:39.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:59:39.774 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:59:40.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:59:40.002 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:40.002 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:59:40.003 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:59:40.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:59:40.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:40.003 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:59:40.069 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803780 2026-02-13T05:59:40.069 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803780 2026-02-13T05:59:40.069 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780' 2026-02-13T05:59:40.069 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:40.069 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:59:40.132 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607556 2026-02-13T05:59:40.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607556 2026-02-13T05:59:40.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607556' 2026-02-13T05:59:40.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:40.133 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:59:40.199 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444035 2026-02-13T05:59:40.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444035 2026-02-13T05:59:40.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607556 2-73014444035' 2026-02-13T05:59:40.200 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:40.200 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:59:40.262 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215107 2026-02-13T05:59:40.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215107 2026-02-13T05:59:40.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607556 2-73014444035 3-103079215107' 2026-02-13T05:59:40.263 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:40.263 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803780 2026-02-13T05:59:40.264 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:40.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:59:40.264 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803780 2026-02-13T05:59:40.265 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:40.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803780 2026-02-13T05:59:40.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803780' 2026-02-13T05:59:40.266 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803780 2026-02-13T05:59:40.266 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:59:40.491 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803778 -lt 25769803780 2026-02-13T05:59:40.491 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:59:41.492 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:59:41.493 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:59:41.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803780 2026-02-13T05:59:41.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:41.717 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607556 2026-02-13T05:59:41.717 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:41.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:59:41.718 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607556 2026-02-13T05:59:41.719 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:41.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607556 2026-02-13T05:59:41.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607556' 2026-02-13T05:59:41.720 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607556 2026-02-13T05:59:41.720 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:59:41.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607556 -lt 51539607556 2026-02-13T05:59:41.944 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:41.945 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444035 2026-02-13T05:59:41.945 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:41.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:59:41.946 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444035 2026-02-13T05:59:41.946 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:41.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444035 2026-02-13T05:59:41.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444035' 2026-02-13T05:59:41.948 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 73014444035 2026-02-13T05:59:41.948 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T05:59:42.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444036 -lt 73014444035 2026-02-13T05:59:42.172 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:42.172 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-103079215107 2026-02-13T05:59:42.172 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:42.173 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T05:59:42.174 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-103079215107 2026-02-13T05:59:42.174 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:42.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=103079215107 2026-02-13T05:59:42.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 103079215107' 2026-02-13T05:59:42.176 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 103079215107 2026-02-13T05:59:42.176 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T05:59:42.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 103079215107 -lt 103079215107 2026-02-13T05:59:42.400 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T05:59:42.401 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:59:42.401 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:59:42.714 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T05:59:42.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T05:59:42.715 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T05:59:42.716 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T05:59:42.716 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T05:59:42.716 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T05:59:42.716 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T05:59:42.716 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T05:59:42.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T05:59:42.937 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T05:59:42.937 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T05:59:42.938 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T05:59:43.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T05:59:43.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T05:59:43.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T05:59:43.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:281: TEST_rados_get_subread_eio_shard_0: local shard_id=0 2026-02-13T05:59:43.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:282: TEST_rados_get_subread_eio_shard_0: rados_put_get_data eio td/test-erasure-eio 0 2026-02-13T05:59:43.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=eio 2026-02-13T05:59:43.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-13T05:59:43.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-13T05:59:43.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-13T05:59:43.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=0 2026-02-13T05:59:43.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-13T05:59:43.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg= 2026-02-13T05:59:43.250 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-13T05:59:43.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-eio-72120-0 2026-02-13T05:59:43.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-eio-72120-0 2026-02-13T05:59:43.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T05:59:43.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T05:59:43.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-eio-72120-0 2026-02-13T05:59:43.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:59:43.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T05:59:43.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:59:43.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T05:59:43.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:59:43.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T05:59:43.251 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T05:59:43.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T05:59:43.252 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-eio-72120-0 td/test-erasure-eio/ORIGINAL 2026-02-13T05:59:43.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-72120-0 td/test-erasure-eio 0 2026-02-13T05:59:43.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T05:59:43.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T05:59:43.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T05:59:43.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T05:59:43.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T05:59:43.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T05:59:43.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj-eio-72120-0 2026-02-13T05:59:43.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T05:59:43.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T05:59:43.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T05:59:43.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-13T05:59:43.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T05:59:43.270 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj-eio-72120-0 2026-02-13T05:59:43.270 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:59:43.271 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72120-0 2026-02-13T05:59:43.271 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72120-0 2026-02-13T05:59:43.271 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:59:43.493 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:59:43.494 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:43.494 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:59:43.494 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:59:43.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '2') 2026-02-13T05:59:43.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T05:59:43.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-13T05:59:43.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T05:59:43.494 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-13T05:59:43.496 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T05:59:43.496 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-13T05:59:43.496 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T05:59:43.496 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-13T05:59:43.497 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T05:59:43.497 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T05:59:43.497 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T05:59:43.497 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-13T05:59:43.497 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T05:59:43.497 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T05:59:43.497 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:59:43.497 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:43.497 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:43.497 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T05:59:43.497 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-13T05:59:43.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T05:59:43.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T05:59:43.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T05:59:43.550 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-13T05:59:43.550 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T05:59:43.550 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T05:59:43.550 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:59:43.550 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:43.550 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:43.550 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T05:59:43.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T05:59:43.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.3.asok injectdataerr pool-jerasure obj-eio-72120-0 0 2026-02-13T05:59:43.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-72120-0 2026-02-13T05:59:43.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:59:43.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:59:43.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-72120-0 2026-02-13T05:59:43.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T05:59:43.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T05:59:43.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-72120-0 td/test-erasure-eio/COPY 2026-02-13T05:59:43.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T05:59:43.619 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T05:59:43.620 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' '' = recovery ']' 2026-02-13T05:59:43.620 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: expr 0 + 1 2026-02-13T05:59:43.622 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: local another_shard_id=1 2026-02-13T05:59:43.622 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:182: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-72120-0 td/test-erasure-eio 1 2026-02-13T05:59:43.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T05:59:43.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T05:59:43.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T05:59:43.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T05:59:43.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T05:59:43.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T05:59:43.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj-eio-72120-0 2026-02-13T05:59:43.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T05:59:43.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T05:59:43.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T05:59:43.623 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=1 2026-02-13T05:59:43.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T05:59:43.624 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj-eio-72120-0 2026-02-13T05:59:43.624 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T05:59:43.624 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72120-0 2026-02-13T05:59:43.624 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72120-0 2026-02-13T05:59:43.624 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T05:59:43.851 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T05:59:43.851 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:43.851 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T05:59:43.851 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T05:59:43.851 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '2') 2026-02-13T05:59:43.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T05:59:43.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-13T05:59:43.852 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T05:59:43.853 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/1/type 2026-02-13T05:59:43.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T05:59:43.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-13T05:59:43.853 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T05:59:43.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-13T05:59:43.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T05:59:43.854 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T05:59:43.854 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T05:59:43.854 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-13T05:59:43.854 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T05:59:43.854 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T05:59:43.855 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:59:43.855 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:43.855 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:43.855 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.1.asok 2026-02-13T05:59:43.855 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-13T05:59:43.903 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T05:59:43.904 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T05:59:43.904 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T05:59:43.905 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-13T05:59:43.905 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T05:59:43.906 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T05:59:43.906 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:59:43.906 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:43.906 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:43.906 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.1.asok 2026-02-13T05:59:43.906 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T05:59:43.906 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.1.asok injectdataerr pool-jerasure obj-eio-72120-0 1 2026-02-13T05:59:43.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:183: rados_put_get_data: '[' 0 -eq 1 -a 1 -eq 2 ']' 2026-02-13T05:59:43.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-72120-0 fail 2026-02-13T05:59:43.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T05:59:43.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T05:59:43.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-72120-0 2026-02-13T05:59:43.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-13T05:59:43.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-13T05:59:43.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-eio-72120-0 td/test-erasure-eio/COPY 2026-02-13T05:59:43.972 INFO:tasks.workunit.client.0.trial024.stderr:error getting pool-jerasure/obj-eio-72120-0: (5) Input/output error 2026-02-13T05:59:43.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-13T05:59:43.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: rados_put_get_data: rm td/test-erasure-eio/ORIGINAL 2026-02-13T05:59:43.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:283: TEST_rados_get_subread_eio_shard_0: delete_erasure_coded_pool pool-jerasure 2026-02-13T05:59:43.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:59:43.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T05:59:44.245 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T05:59:44.253 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T05:59:44.529 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T05:59:44.537 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T05:59:44.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:59:44.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:59:44.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:59:44.538 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:59:44.538 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:59:44.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:59:44.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:59:44.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:59:44.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:59:44.647 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:59:44.648 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:59:44.648 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:59:44.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:59:44.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:59:44.650 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:59:44.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:59:44.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:59:44.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:59:44.652 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:59:44.652 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:59:44.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:59:44.653 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:59:44.661 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:59:44.662 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:44.662 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:44.662 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:59:44.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:59:44.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:59:44.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T05:59:44.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T05:59:44.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T05:59:44.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T05:59:44.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T05:59:44.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T05:59:44.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T05:59:44.664 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T05:59:44.664 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T05:59:44.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T05:59:44.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T05:59:44.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T05:59:44.665 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T05:59:44.665 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T05:59:44.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T05:59:44.666 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T05:59:44.667 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T05:59:44.667 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T05:59:44.668 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T05:59:44.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:59:44.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T05:59:44.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T05:59:44.669 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T05:59:44.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T05:59:44.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T05:59:44.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T05:59:44.672 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T05:59:44.672 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:44.673 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:44.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T05:59:44.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T05:59:44.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T05:59:44.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T05:59:44.675 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T05:59:44.675 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:44.675 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:44.675 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T05:59:44.676 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T05:59:44.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T05:59:44.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T05:59:44.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T05:59:44.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T05:59:44.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T05:59:44.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T05:59:44.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T05:59:44.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T05:59:44.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T05:59:44.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T05:59:44.697 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T05:59:44.697 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:44.697 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:44.698 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:44.698 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:44.698 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:44.698 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:44.698 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T05:59:44.724 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T05:59:44.726 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T05:59:44.726 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:59:44.726 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:59:44.726 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T05:59:44.726 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T05:59:44.726 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:59:44.726 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:59:44.726 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:59:44.726 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:59:44.726 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:44.727 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:44.727 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:59:44.727 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:59:44.727 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T05:59:44.771 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T05:59:44.771 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T05:59:44.771 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T05:59:44.771 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T05:59:44.771 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T05:59:44.772 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T05:59:44.773 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:59:44.773 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:59:44.773 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:59:44.773 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:44.773 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:44.773 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:59:44.773 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T05:59:44.773 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T05:59:44.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T05:59:44.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T05:59:44.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T05:59:44.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T05:59:44.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T05:59:44.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T05:59:44.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T05:59:44.917 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T05:59:44.917 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:44.918 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:44.918 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:44.918 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:44.918 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:44.918 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:44.918 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:59:44.919 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T05:59:44.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T05:59:44.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T05:59:45.034 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T05:59:45.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:59:46.044 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T05:59:46.044 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T05:59:46.044 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T05:59:46.044 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:59:46.044 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:46.044 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:46.044 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T05:59:46.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T05:59:46.044 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T05:59:46.085 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:59:46.090 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T05:59:46.091 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:59:44.715+0000 7fb8d3c0ed80 0 load: jerasure load: lrc 2026-02-13T05:59:46.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_subread_eio_shard_1 td/test-erasure-eio 2026-02-13T05:59:46.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:287: TEST_rados_get_subread_eio_shard_1: local dir=td/test-erasure-eio 2026-02-13T05:59:46.092 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:288: TEST_rados_get_subread_eio_shard_1: setup_osds 4 2026-02-13T05:59:46.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-13T05:59:46.093 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T05:59:46.093 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-13T05:59:46.093 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-13T05:59:46.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:59:46.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T05:59:46.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:59:46.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:59:46.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T05:59:46.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:59:46.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T05:59:46.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:59:46.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:59:46.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:59:46.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:59:46.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T05:59:46.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T05:59:46.098 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:59:46.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:59:46.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:59:46.099 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:59:46.099 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:46.099 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:46.099 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:46.099 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:46.099 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:46.099 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:46.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:46.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:59:46.099 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1dbca7ff-5fc3-41ea-9e2d-44739ce93149 2026-02-13T05:59:46.100 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1dbca7ff-5fc3-41ea-9e2d-44739ce93149' 2026-02-13T05:59:46.101 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 1dbca7ff-5fc3-41ea-9e2d-44739ce93149 2026-02-13T05:59:46.101 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:59:46.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDSvY5pPGuKBhAAIdnSgUPQUI1VjTJN1UcNcw== 2026-02-13T05:59:46.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDSvY5pPGuKBhAAIdnSgUPQUI1VjTJN1UcNcw=="}' 2026-02-13T05:59:46.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1dbca7ff-5fc3-41ea-9e2d-44739ce93149 -i td/test-erasure-eio/0/new.json 2026-02-13T05:59:46.219 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:59:46.227 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T05:59:46.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDSvY5pPGuKBhAAIdnSgUPQUI1VjTJN1UcNcw== --osd-uuid 1dbca7ff-5fc3-41ea-9e2d-44739ce93149 2026-02-13T05:59:46.246 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:46.244+0000 7f59449b0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:46.247 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:46.245+0000 7f59449b0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:46.248 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:46.246+0000 7f59449b0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:46.249 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:46.247+0000 7f59449b0900 -1 bdev(0x560dcbc4ac00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T05:59:46.249 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:46.247+0000 7f59449b0900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T05:59:46.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T05:59:46.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:59:46.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T05:59:46.660 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T05:59:46.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:59:46.772 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T05:59:46.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T05:59:46.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:59:46.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:59:46.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:59:46.773 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:59:46.789 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:46.787+0000 7f77f7e70900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:46.791 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:46.789+0000 7f77f7e70900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:46.792 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:46.790+0000 7f77f7e70900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:46.871 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T05:59:46.871 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:59:46.871 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T05:59:46.871 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:59:46.871 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:59:46.872 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:46.872 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:59:46.872 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:59:46.872 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:46.872 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:59:46.972 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:59:47.008 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:47.007+0000 7f77f7e70900 -1 Falling back to public interface 2026-02-13T05:59:47.292 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:47.290+0000 7f77f7e70900 -1 osd.0 0 log_to_monitors true 2026-02-13T05:59:47.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:59:47.973 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:47.974 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:59:47.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:59:47.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:47.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T05:59:48.199 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3283482733,v1:127.0.0.1:6803/3283482733] [v2:127.0.0.1:6804/3283482733,v1:127.0.0.1:6805/3283482733] exists,up 1dbca7ff-5fc3-41ea-9e2d-44739ce93149 2026-02-13T05:59:48.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:59:48.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:59:48.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:59:48.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:59:48.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T05:59:48.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:59:48.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:59:48.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T05:59:48.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:59:48.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T05:59:48.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:59:48.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:59:48.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:59:48.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:59:48.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T05:59:48.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T05:59:48.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:59:48.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:59:48.204 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:59:48.204 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:59:48.204 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:48.204 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:48.204 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:48.204 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:48.205 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:48.205 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:48.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:48.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:59:48.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:59:48.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:59:48.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:59:48.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:59:48.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:59:48.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:59:48.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:59:48.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:59:48.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:59:48.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:59:48.206 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T05:59:48.206 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:59:48.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9fbb3214-3f0f-44be-a885-182e535e5edb 2026-02-13T05:59:48.207 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 9fbb3214-3f0f-44be-a885-182e535e5edb' 2026-02-13T05:59:48.207 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 9fbb3214-3f0f-44be-a885-182e535e5edb 2026-02-13T05:59:48.207 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:59:48.215 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDUvY5pP7PDDBAALoKpfHO5i61t2V8DPSJT4A== 2026-02-13T05:59:48.215 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDUvY5pP7PDDBAALoKpfHO5i61t2V8DPSJT4A=="}' 2026-02-13T05:59:48.215 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9fbb3214-3f0f-44be-a885-182e535e5edb -i td/test-erasure-eio/1/new.json 2026-02-13T05:59:48.442 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:59:48.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T05:59:48.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDUvY5pP7PDDBAALoKpfHO5i61t2V8DPSJT4A== --osd-uuid 9fbb3214-3f0f-44be-a885-182e535e5edb 2026-02-13T05:59:48.470 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:48.469+0000 7f3b3b6f6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:48.471 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:48.470+0000 7f3b3b6f6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:48.472 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:48.471+0000 7f3b3b6f6900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:48.473 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:48.471+0000 7f3b3b6f6900 -1 bdev(0x55db1ba7ac00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T05:59:48.473 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:48.471+0000 7f3b3b6f6900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T05:59:48.793 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T05:59:48.794 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:59:48.795 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T05:59:48.795 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T05:59:48.795 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:59:49.124 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T05:59:49.125 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T05:59:49.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:59:49.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:59:49.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:59:49.126 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:59:49.141 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:49.139+0000 7fbae600d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:49.142 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:49.141+0000 7fbae600d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:49.143 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:49.142+0000 7fbae600d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:49.278 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:49.277+0000 7fbae600d900 -1 Falling back to public interface 2026-02-13T05:59:49.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T05:59:49.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:59:49.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T05:59:49.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:59:49.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:59:49.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:49.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:59:49.349 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:59:49.349 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:49.349 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:59:49.575 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:59:49.584 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:49.582+0000 7fbae600d900 -1 osd.1 0 log_to_monitors true 2026-02-13T05:59:50.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:59:50.576 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:50.576 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:59:50.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:59:50.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:50.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T05:59:50.802 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2165797342,v1:127.0.0.1:6811/2165797342] [v2:127.0.0.1:6812/2165797342,v1:127.0.0.1:6813/2165797342] exists,up 9fbb3214-3f0f-44be-a885-182e535e5edb 2026-02-13T05:59:50.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:59:50.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:59:50.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:59:50.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:59:50.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T05:59:50.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:59:50.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:59:50.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T05:59:50.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:59:50.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T05:59:50.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:59:50.803 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:59:50.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:59:50.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:59:50.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T05:59:50.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T05:59:50.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:59:50.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:59:50.804 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:59:50.804 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:59:50.804 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:50.804 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T05:59:50.805 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:59:50.806 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=fb197d8d-952a-4114-8669-b5b0bf380aec 2026-02-13T05:59:50.806 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 fb197d8d-952a-4114-8669-b5b0bf380aec' 2026-02-13T05:59:50.806 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 fb197d8d-952a-4114-8669-b5b0bf380aec 2026-02-13T05:59:50.807 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:59:50.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDWvY5pMqi/MBAA6RMIh4QRX4w5/9HyugrCdw== 2026-02-13T05:59:50.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDWvY5pMqi/MBAA6RMIh4QRX4w5/9HyugrCdw=="}' 2026-02-13T05:59:50.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new fb197d8d-952a-4114-8669-b5b0bf380aec -i td/test-erasure-eio/2/new.json 2026-02-13T05:59:51.042 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T05:59:51.050 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T05:59:51.051 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDWvY5pMqi/MBAA6RMIh4QRX4w5/9HyugrCdw== --osd-uuid fb197d8d-952a-4114-8669-b5b0bf380aec 2026-02-13T05:59:51.070 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:51.068+0000 7f331f422900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:51.071 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:51.070+0000 7f331f422900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:51.072 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:51.071+0000 7f331f422900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:51.072 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:51.071+0000 7f331f422900 -1 bdev(0x55796bf36c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T05:59:51.073 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:51.071+0000 7f331f422900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T05:59:51.391 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T05:59:51.391 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:59:51.392 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T05:59:51.393 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T05:59:51.393 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:59:51.712 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T05:59:51.712 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T05:59:51.712 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:59:51.712 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:59:51.713 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:59:51.713 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:59:51.729 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:51.728+0000 7f725420d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:51.731 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:51.729+0000 7f725420d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:51.731 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:51.730+0000 7f725420d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:51.851 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:51.849+0000 7f725420d900 -1 Falling back to public interface 2026-02-13T05:59:51.937 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T05:59:51.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:59:51.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T05:59:51.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:59:51.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:59:51.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:51.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:59:51.938 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:59:51.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:51.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:59:52.152 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:52.151+0000 7f725420d900 -1 osd.2 0 log_to_monitors true 2026-02-13T05:59:52.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:59:53.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:59:53.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:53.170 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:59:53.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:59:53.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:53.170 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T05:59:53.399 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2541498475,v1:127.0.0.1:6819/2541498475] [v2:127.0.0.1:6820/2541498475,v1:127.0.0.1:6821/2541498475] exists,up fb197d8d-952a-4114-8669-b5b0bf380aec 2026-02-13T05:59:53.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:59:53.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:59:53.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:59:53.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T05:59:53.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T05:59:53.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T05:59:53.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T05:59:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T05:59:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T05:59:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T05:59:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T05:59:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T05:59:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T05:59:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T05:59:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T05:59:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T05:59:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T05:59:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T05:59:53.404 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T05:59:53.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T05:59:53.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T05:59:53.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T05:59:53.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T05:59:53.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T05:59:53.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T05:59:53.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T05:59:53.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T05:59:53.406 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T05:59:53.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=01c40a44-6d9e-44b1-b6ff-fd5b5631b929 2026-02-13T05:59:53.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 01c40a44-6d9e-44b1-b6ff-fd5b5631b929' 2026-02-13T05:59:53.407 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 01c40a44-6d9e-44b1-b6ff-fd5b5631b929 2026-02-13T05:59:53.407 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T05:59:53.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDZvY5pyRu0GBAA80M58m4GxruSq6wwdCYDIw== 2026-02-13T05:59:53.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDZvY5pyRu0GBAA80M58m4GxruSq6wwdCYDIw=="}' 2026-02-13T05:59:53.415 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 01c40a44-6d9e-44b1-b6ff-fd5b5631b929 -i td/test-erasure-eio/3/new.json 2026-02-13T05:59:53.648 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T05:59:53.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T05:59:53.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDZvY5pyRu0GBAA80M58m4GxruSq6wwdCYDIw== --osd-uuid 01c40a44-6d9e-44b1-b6ff-fd5b5631b929 2026-02-13T05:59:53.674 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:53.672+0000 7fc2886f1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:53.675 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:53.674+0000 7fc2886f1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:53.676 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:53.675+0000 7fc2886f1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:53.677 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:53.675+0000 7fc2886f1900 -1 bdev(0x559b654f6c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T05:59:53.677 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:53.675+0000 7fc2886f1900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T05:59:54.018 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T05:59:54.018 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T05:59:54.018 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T05:59:54.019 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T05:59:54.019 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T05:59:54.336 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T05:59:54.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T05:59:54.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T05:59:54.337 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T05:59:54.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T05:59:54.338 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T05:59:54.353 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:54.352+0000 7f880c683900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:54.355 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:54.353+0000 7f880c683900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:54.355 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:54.354+0000 7f880c683900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T05:59:54.487 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:54.485+0000 7f880c683900 -1 Falling back to public interface 2026-02-13T05:59:54.561 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T05:59:54.561 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T05:59:54.561 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T05:59:54.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T05:59:54.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T05:59:54.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:54.562 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T05:59:54.562 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T05:59:54.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:54.563 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:59:54.790 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T05:59:54.794 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T05:59:54.792+0000 7f880c683900 -1 osd.3 0 log_to_monitors true 2026-02-13T05:59:55.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T05:59:55.791 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T05:59:55.791 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T05:59:55.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T05:59:55.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T05:59:55.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T05:59:56.012 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 27 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3512530808,v1:127.0.0.1:6827/3512530808] [v2:127.0.0.1:6828/3512530808,v1:127.0.0.1:6829/3512530808] exists,up 01c40a44-6d9e-44b1-b6ff-fd5b5631b929 2026-02-13T05:59:56.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T05:59:56.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T05:59:56.013 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T05:59:56.013 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T05:59:56.013 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T05:59:56.013 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T05:59:56.013 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T05:59:56.014 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T05:59:56.014 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T05:59:56.014 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T05:59:56.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T05:59:56.014 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T05:59:56.060 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T05:59:56.064 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T05:59:56.066 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T05:59:47.009+0000 7f77f7e70900 0 load: jerasure load: lrc 2026-02-13T05:59:56.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:290: TEST_rados_get_subread_eio_shard_1: local poolname=pool-jerasure 2026-02-13T05:59:56.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:291: TEST_rados_get_subread_eio_shard_1: create_erasure_coded_pool pool-jerasure 2 1 2026-02-13T05:59:56.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T05:59:56.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T05:59:56.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-13T05:59:56.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T05:59:56.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-13T05:59:56.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T05:59:56.067 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-13T05:59:56.351 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T05:59:56.351 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T05:59:56.722 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T05:59:56.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T05:59:57.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T05:59:57.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T05:59:57.733 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T05:59:57.733 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T05:59:57.733 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T05:59:57.734 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T05:59:57.734 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T05:59:57.734 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T05:59:57.734 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T05:59:57.734 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T05:59:57.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T05:59:57.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T05:59:57.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T05:59:57.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T05:59:57.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T05:59:57.821 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T05:59:58.046 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T05:59:58.046 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T05:59:58.046 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T05:59:58.046 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T05:59:58.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T05:59:58.047 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:58.047 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T05:59:58.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803780 2026-02-13T05:59:58.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803780 2026-02-13T05:59:58.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780' 2026-02-13T05:59:58.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:58.111 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T05:59:58.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574853 2026-02-13T05:59:58.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574853 2026-02-13T05:59:58.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574853' 2026-02-13T05:59:58.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:58.175 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T05:59:58.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411331 2026-02-13T05:59:58.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411331 2026-02-13T05:59:58.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574853 2-77309411331' 2026-02-13T05:59:58.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T05:59:58.239 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T05:59:58.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116995 2026-02-13T05:59:58.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116995 2026-02-13T05:59:58.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574853 2-77309411331 3-115964116995' 2026-02-13T05:59:58.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:58.305 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803780 2026-02-13T05:59:58.305 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:58.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T05:59:58.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803780 2026-02-13T05:59:58.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:58.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803780 2026-02-13T05:59:58.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803780' 2026-02-13T05:59:58.307 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803780 2026-02-13T05:59:58.307 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:59:58.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803778 -lt 25769803780 2026-02-13T05:59:58.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T05:59:59.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T05:59:59.531 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T05:59:59.758 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803780 2026-02-13T05:59:59.759 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:59.759 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574853 2026-02-13T05:59:59.759 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:59.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T05:59:59.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574853 2026-02-13T05:59:59.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:59.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574853 2026-02-13T05:59:59.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574853' 2026-02-13T05:59:59.762 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 55834574853 2026-02-13T05:59:59.762 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T05:59:59.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574853 -lt 55834574853 2026-02-13T05:59:59.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T05:59:59.988 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411331 2026-02-13T05:59:59.988 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T05:59:59.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T05:59:59.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411331 2026-02-13T05:59:59.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T05:59:59.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411331 2026-02-13T05:59:59.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411331' 2026-02-13T05:59:59.991 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 77309411331 2026-02-13T05:59:59.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T06:00:00.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411332 -lt 77309411331 2026-02-13T06:00:00.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:00.215 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116995 2026-02-13T06:00:00.215 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:00.216 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T06:00:00.216 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116995 2026-02-13T06:00:00.217 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:00.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116995 2026-02-13T06:00:00.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116995' 2026-02-13T06:00:00.218 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 115964116995 2026-02-13T06:00:00.218 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T06:00:00.442 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116995 -lt 115964116995 2026-02-13T06:00:00.442 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T06:00:00.443 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:00:00.443 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:00:00.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T06:00:00.752 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T06:00:00.753 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T06:00:00.753 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T06:00:00.753 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T06:00:00.753 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T06:00:00.753 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T06:00:00.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T06:00:00.975 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T06:00:00.975 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T06:00:00.976 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:00:00.976 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:00:01.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T06:00:01.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T06:00:01.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T06:00:01.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:293: TEST_rados_get_subread_eio_shard_1: local shard_id=1 2026-02-13T06:00:01.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:294: TEST_rados_get_subread_eio_shard_1: rados_put_get_data eio td/test-erasure-eio 1 2026-02-13T06:00:01.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=eio 2026-02-13T06:00:01.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-13T06:00:01.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-13T06:00:01.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-13T06:00:01.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=1 2026-02-13T06:00:01.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-13T06:00:01.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg= 2026-02-13T06:00:01.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-13T06:00:01.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-eio-72120-1 2026-02-13T06:00:01.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-eio-72120-1 2026-02-13T06:00:01.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T06:00:01.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T06:00:01.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-eio-72120-1 2026-02-13T06:00:01.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:00:01.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T06:00:01.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:00:01.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T06:00:01.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:00:01.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T06:00:01.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:00:01.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T06:00:01.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-eio-72120-1 td/test-erasure-eio/ORIGINAL 2026-02-13T06:00:01.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-72120-1 td/test-erasure-eio 1 2026-02-13T06:00:01.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T06:00:01.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T06:00:01.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T06:00:01.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T06:00:01.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T06:00:01.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T06:00:01.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj-eio-72120-1 2026-02-13T06:00:01.312 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T06:00:01.313 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T06:00:01.313 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T06:00:01.313 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=1 2026-02-13T06:00:01.313 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T06:00:01.313 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj-eio-72120-1 2026-02-13T06:00:01.313 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T06:00:01.313 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72120-1 2026-02-13T06:00:01.313 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72120-1 2026-02-13T06:00:01.313 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T06:00:01.540 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T06:00:01.540 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:01.540 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T06:00:01.540 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T06:00:01.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '2') 2026-02-13T06:00:01.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T06:00:01.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-13T06:00:01.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T06:00:01.541 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/1/type 2026-02-13T06:00:01.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T06:00:01.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-13T06:00:01.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T06:00:01.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-13T06:00:01.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T06:00:01.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T06:00:01.543 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T06:00:01.543 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-13T06:00:01.543 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T06:00:01.543 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T06:00:01.543 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:01.544 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:01.544 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:01.544 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.1.asok 2026-02-13T06:00:01.544 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-13T06:00:01.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T06:00:01.593 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T06:00:01.594 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T06:00:01.594 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-13T06:00:01.594 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T06:00:01.594 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T06:00:01.595 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:01.596 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:01.596 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:01.596 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.1.asok 2026-02-13T06:00:01.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T06:00:01.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.1.asok injectdataerr pool-jerasure obj-eio-72120-1 1 2026-02-13T06:00:01.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-72120-1 2026-02-13T06:00:01.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T06:00:01.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T06:00:01.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-72120-1 2026-02-13T06:00:01.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T06:00:01.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T06:00:01.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-72120-1 td/test-erasure-eio/COPY 2026-02-13T06:00:01.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T06:00:01.666 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T06:00:01.667 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' '' = recovery ']' 2026-02-13T06:00:01.668 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: expr 1 + 1 2026-02-13T06:00:01.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: local another_shard_id=2 2026-02-13T06:00:01.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:182: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-72120-1 td/test-erasure-eio 2 2026-02-13T06:00:01.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T06:00:01.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T06:00:01.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T06:00:01.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T06:00:01.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T06:00:01.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T06:00:01.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj-eio-72120-1 2026-02-13T06:00:01.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T06:00:01.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T06:00:01.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T06:00:01.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=2 2026-02-13T06:00:01.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T06:00:01.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj-eio-72120-1 2026-02-13T06:00:01.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T06:00:01.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72120-1 2026-02-13T06:00:01.672 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72120-1 2026-02-13T06:00:01.672 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T06:00:01.896 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T06:00:01.896 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:01.896 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T06:00:01.896 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T06:00:01.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '2') 2026-02-13T06:00:01.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T06:00:01.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=2 2026-02-13T06:00:01.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T06:00:01.897 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/2/type 2026-02-13T06:00:01.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T06:00:01.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 2 bluestore_debug_inject_read_err true 2026-02-13T06:00:01.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T06:00:01.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=2 2026-02-13T06:00:01.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T06:00:01.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T06:00:01.899 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T06:00:01.899 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.2 2026-02-13T06:00:01.899 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T06:00:01.899 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T06:00:01.900 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:01.900 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:01.900 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:01.900 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.2.asok 2026-02-13T06:00:01.900 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.2.asok config set bluestore_debug_inject_read_err true 2026-02-13T06:00:01.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T06:00:01.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T06:00:01.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T06:00:01.950 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.2 2026-02-13T06:00:01.950 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T06:00:01.950 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T06:00:01.950 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:01.950 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:01.950 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:01.950 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.2.asok 2026-02-13T06:00:01.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T06:00:01.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.2.asok injectdataerr pool-jerasure obj-eio-72120-1 2 2026-02-13T06:00:01.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:183: rados_put_get_data: '[' 1 -eq 1 -a 2 -eq 2 ']' 2026-02-13T06:00:01.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:188: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-72120-1 2026-02-13T06:00:01.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T06:00:01.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T06:00:01.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-72120-1 2026-02-13T06:00:01.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T06:00:01.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T06:00:01.999 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-72120-1 td/test-erasure-eio/COPY 2026-02-13T06:00:02.017 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T06:00:02.018 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T06:00:02.018 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: rados_put_get_data: rm td/test-erasure-eio/ORIGINAL 2026-02-13T06:00:02.019 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:295: TEST_rados_get_subread_eio_shard_1: delete_erasure_coded_pool pool-jerasure 2026-02-13T06:00:02.020 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T06:00:02.020 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T06:00:02.287 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T06:00:02.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T06:00:02.570 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T06:00:02.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T06:00:02.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T06:00:02.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T06:00:02.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T06:00:02.579 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T06:00:02.579 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T06:00:02.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T06:00:02.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T06:00:02.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T06:00:02.688 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T06:00:02.688 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T06:00:02.689 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T06:00:02.690 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T06:00:02.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T06:00:02.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T06:00:02.691 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T06:00:02.693 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:00:02.693 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T06:00:02.693 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T06:00:02.693 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:00:02.694 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T06:00:02.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T06:00:02.695 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T06:00:02.704 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T06:00:02.704 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:02.704 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:02.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T06:00:02.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T06:00:02.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T06:00:02.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T06:00:02.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T06:00:02.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T06:00:02.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T06:00:02.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T06:00:02.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T06:00:02.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T06:00:02.707 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T06:00:02.707 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T06:00:02.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T06:00:02.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T06:00:02.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T06:00:02.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T06:00:02.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T06:00:02.708 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T06:00:02.709 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T06:00:02.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T06:00:02.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T06:00:02.710 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T06:00:02.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:00:02.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T06:00:02.711 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T06:00:02.711 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:00:02.712 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T06:00:02.713 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T06:00:02.713 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T06:00:02.714 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T06:00:02.714 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:02.714 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:02.714 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T06:00:02.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T06:00:02.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T06:00:02.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T06:00:02.716 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T06:00:02.716 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:02.717 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:02.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T06:00:02.717 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T06:00:02.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T06:00:02.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T06:00:02.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T06:00:02.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T06:00:02.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T06:00:02.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T06:00:02.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T06:00:02.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T06:00:02.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T06:00:02.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T06:00:02.739 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T06:00:02.739 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:02.740 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:02.740 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:02.740 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:02.740 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:02.740 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:02.740 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T06:00:02.766 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T06:00:02.767 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T06:00:02.768 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T06:00:02.768 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T06:00:02.768 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T06:00:02.768 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T06:00:02.768 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T06:00:02.768 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T06:00:02.768 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T06:00:02.769 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:02.769 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:02.769 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:02.769 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T06:00:02.769 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T06:00:02.770 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T06:00:02.812 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T06:00:02.812 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T06:00:02.812 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T06:00:02.812 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T06:00:02.813 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T06:00:02.814 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T06:00:02.814 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T06:00:02.814 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T06:00:02.814 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:02.814 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:02.814 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:02.814 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T06:00:02.814 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T06:00:02.815 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T06:00:02.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T06:00:02.858 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T06:00:02.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T06:00:02.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T06:00:02.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T06:00:02.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T06:00:02.859 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T06:00:02.959 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T06:00:02.959 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:02.959 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:02.959 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:02.960 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:02.960 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:02.960 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:02.960 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T06:00:02.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T06:00:02.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T06:00:02.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T06:00:03.074 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T06:00:03.080 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T06:00:04.083 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T06:00:04.083 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T06:00:04.083 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T06:00:04.083 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:04.083 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:04.083 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:04.084 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T06:00:04.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T06:00:04.084 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T06:00:04.124 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T06:00:04.128 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T06:00:04.130 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T06:00:02.759+0000 7fd87e9d4d80 0 load: jerasure load: lrc 2026-02-13T06:00:04.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_subread_missing td/test-erasure-eio 2026-02-13T06:00:04.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:302: TEST_rados_get_subread_missing: local dir=td/test-erasure-eio 2026-02-13T06:00:04.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:303: TEST_rados_get_subread_missing: setup_osds 4 2026-02-13T06:00:04.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-13T06:00:04.131 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T06:00:04.131 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-13T06:00:04.132 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-13T06:00:04.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T06:00:04.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T06:00:04.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T06:00:04.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T06:00:04.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T06:00:04.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T06:00:04.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T06:00:04.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:00:04.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:00:04.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:00:04.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:00:04.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T06:00:04.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T06:00:04.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T06:00:04.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T06:00:04.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:00:04.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T06:00:04.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:04.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:04.137 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:04.137 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:04.137 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:04.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:04.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:04.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:00:04.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T06:00:04.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T06:00:04.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:00:04.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:00:04.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:00:04.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:00:04.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:00:04.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:00:04.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T06:00:04.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T06:00:04.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T06:00:04.138 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T06:00:04.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4f934406-6216-4ade-b3dc-116105fb7097 2026-02-13T06:00:04.139 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 4f934406-6216-4ade-b3dc-116105fb7097' 2026-02-13T06:00:04.139 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 4f934406-6216-4ade-b3dc-116105fb7097 2026-02-13T06:00:04.139 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T06:00:04.147 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDkvY5pgNi8CBAAZubF39bl05AOPlGRpp5TPQ== 2026-02-13T06:00:04.147 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDkvY5pgNi8CBAAZubF39bl05AOPlGRpp5TPQ=="}' 2026-02-13T06:00:04.148 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4f934406-6216-4ade-b3dc-116105fb7097 -i td/test-erasure-eio/0/new.json 2026-02-13T06:00:04.249 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:04.256 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T06:00:04.257 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDkvY5pgNi8CBAAZubF39bl05AOPlGRpp5TPQ== --osd-uuid 4f934406-6216-4ade-b3dc-116105fb7097 2026-02-13T06:00:04.275 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:04.274+0000 7f9b4647c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:04.276 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:04.276+0000 7f9b4647c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:04.277 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:04.277+0000 7f9b4647c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:04.278 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:04.277+0000 7f9b4647c900 -1 bdev(0x5568b4aa8c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T06:00:04.278 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:04.277+0000 7f9b4647c900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T06:00:04.700 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T06:00:04.701 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T06:00:04.701 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T06:00:04.701 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T06:00:04.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T06:00:04.808 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T06:00:04.808 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T06:00:04.809 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:00:04.809 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T06:00:04.809 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T06:00:04.809 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T06:00:04.825 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:04.825+0000 7f929b215900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:04.827 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:04.826+0000 7f929b215900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:04.828 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:04.827+0000 7f929b215900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:04.906 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T06:00:04.906 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:00:04.906 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T06:00:04.906 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:00:04.906 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:00:04.907 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:04.907 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:00:04.907 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:04.907 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:04.908 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T06:00:05.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:00:05.014 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:05.013+0000 7f929b215900 -1 Falling back to public interface 2026-02-13T06:00:05.285 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:05.284+0000 7f929b215900 -1 osd.0 0 log_to_monitors true 2026-02-13T06:00:06.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:00:06.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:06.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:00:06.009 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:00:06.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:06.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T06:00:06.233 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4245756516,v1:127.0.0.1:6803/4245756516] [v2:127.0.0.1:6804/4245756516,v1:127.0.0.1:6805/4245756516] exists,up 4f934406-6216-4ade-b3dc-116105fb7097 2026-02-13T06:00:06.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:00:06.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:00:06.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:00:06.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T06:00:06.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T06:00:06.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T06:00:06.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T06:00:06.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T06:00:06.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T06:00:06.237 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T06:00:06.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:00:06.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:00:06.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:00:06.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:00:06.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T06:00:06.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T06:00:06.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T06:00:06.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T06:00:06.238 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:00:06.238 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T06:00:06.238 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:06.238 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:00:06.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:00:06.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:00:06.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T06:00:06.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T06:00:06.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T06:00:06.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T06:00:06.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=30e21a0f-18ff-46b9-9c80-1bb9f804804d 2026-02-13T06:00:06.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 30e21a0f-18ff-46b9-9c80-1bb9f804804d' 2026-02-13T06:00:06.240 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 30e21a0f-18ff-46b9-9c80-1bb9f804804d 2026-02-13T06:00:06.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T06:00:06.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDmvY5pwrXFDhAA0+KUcXGnBpAE7wHCA7gdtg== 2026-02-13T06:00:06.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDmvY5pwrXFDhAA0+KUcXGnBpAE7wHCA7gdtg=="}' 2026-02-13T06:00:06.249 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 30e21a0f-18ff-46b9-9c80-1bb9f804804d -i td/test-erasure-eio/1/new.json 2026-02-13T06:00:06.473 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:00:06.480 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T06:00:06.481 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDmvY5pwrXFDhAA0+KUcXGnBpAE7wHCA7gdtg== --osd-uuid 30e21a0f-18ff-46b9-9c80-1bb9f804804d 2026-02-13T06:00:06.499 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:06.499+0000 7fe508579900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:06.501 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:06.500+0000 7fe508579900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:06.502 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:06.501+0000 7fe508579900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:06.502 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:06.501+0000 7fe508579900 -1 bdev(0x55d11040ec00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T06:00:06.502 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:06.502+0000 7fe508579900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T06:00:06.820 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T06:00:06.820 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T06:00:06.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T06:00:06.821 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T06:00:06.821 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T06:00:07.133 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T06:00:07.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T06:00:07.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:00:07.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T06:00:07.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T06:00:07.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T06:00:07.151 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:07.150+0000 7f70eb60c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:07.152 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:07.151+0000 7f70eb60c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:07.153 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:07.152+0000 7f70eb60c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:07.295 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:07.295+0000 7f70eb60c900 -1 Falling back to public interface 2026-02-13T06:00:07.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T06:00:07.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:00:07.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T06:00:07.359 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:00:07.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:00:07.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:07.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:00:07.360 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:07.360 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:07.361 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T06:00:07.583 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:00:07.617 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:07.616+0000 7f70eb60c900 -1 osd.1 0 log_to_monitors true 2026-02-13T06:00:08.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:00:08.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:08.585 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:00:08.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:00:08.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:08.586 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T06:00:08.809 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/256258741,v1:127.0.0.1:6811/256258741] [v2:127.0.0.1:6812/256258741,v1:127.0.0.1:6813/256258741] exists,up 30e21a0f-18ff-46b9-9c80-1bb9f804804d 2026-02-13T06:00:08.813 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:00:08.813 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:00:08.813 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:00:08.813 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T06:00:08.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T06:00:08.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T06:00:08.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T06:00:08.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T06:00:08.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T06:00:08.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T06:00:08.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:00:08.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:00:08.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:00:08.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:00:08.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T06:00:08.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T06:00:08.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T06:00:08.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T06:00:08.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:00:08.815 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T06:00:08.815 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:08.815 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:08.815 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:08.815 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:08.815 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:08.815 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:08.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T06:00:08.816 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T06:00:08.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=af9cf217-abc5-4c3e-8204-95a1b53474b5 2026-02-13T06:00:08.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 af9cf217-abc5-4c3e-8204-95a1b53474b5' 2026-02-13T06:00:08.817 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 af9cf217-abc5-4c3e-8204-95a1b53474b5 2026-02-13T06:00:08.817 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T06:00:08.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDovY5pickrMRAAWba9bdI9hKP8KrI3y4rfVA== 2026-02-13T06:00:08.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDovY5pickrMRAAWba9bdI9hKP8KrI3y4rfVA=="}' 2026-02-13T06:00:08.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new af9cf217-abc5-4c3e-8204-95a1b53474b5 -i td/test-erasure-eio/2/new.json 2026-02-13T06:00:09.056 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T06:00:09.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T06:00:09.066 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDovY5pickrMRAAWba9bdI9hKP8KrI3y4rfVA== --osd-uuid af9cf217-abc5-4c3e-8204-95a1b53474b5 2026-02-13T06:00:09.084 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:09.084+0000 7f6fde5c1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:09.086 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:09.085+0000 7f6fde5c1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:09.087 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:09.086+0000 7f6fde5c1900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:09.087 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:09.087+0000 7f6fde5c1900 -1 bdev(0x5559d94d0c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T06:00:09.088 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:09.087+0000 7f6fde5c1900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T06:00:09.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T06:00:09.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T06:00:09.424 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T06:00:09.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T06:00:09.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T06:00:09.733 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T06:00:09.734 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T06:00:09.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:00:09.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T06:00:09.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T06:00:09.735 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T06:00:09.752 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:09.752+0000 7f8ae547c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:09.754 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:09.753+0000 7f8ae547c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:09.755 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:09.754+0000 7f8ae547c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:09.881 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:09.881+0000 7f8ae547c900 -1 Falling back to public interface 2026-02-13T06:00:09.961 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T06:00:09.961 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:00:09.961 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T06:00:09.961 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:00:09.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:00:09.962 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:09.962 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:09.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:00:09.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:09.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T06:00:10.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:00:10.237 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:10.237+0000 7f8ae547c900 -1 osd.2 0 log_to_monitors true 2026-02-13T06:00:11.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:00:11.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:11.189 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:00:11.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:00:11.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:11.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T06:00:11.415 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 17 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2905889906,v1:127.0.0.1:6819/2905889906] [v2:127.0.0.1:6820/2905889906,v1:127.0.0.1:6821/2905889906] exists,up af9cf217-abc5-4c3e-8204-95a1b53474b5 2026-02-13T06:00:11.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:00:11.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:00:11.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:00:11.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T06:00:11.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T06:00:11.419 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T06:00:11.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T06:00:11.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T06:00:11.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T06:00:11.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T06:00:11.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:00:11.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:00:11.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:00:11.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:00:11.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T06:00:11.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T06:00:11.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T06:00:11.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T06:00:11.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:00:11.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T06:00:11.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:11.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:11.421 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:11.421 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:11.421 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:11.421 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:11.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:11.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:00:11.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T06:00:11.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T06:00:11.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:00:11.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:00:11.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:00:11.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:00:11.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:00:11.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:00:11.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T06:00:11.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T06:00:11.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T06:00:11.422 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T06:00:11.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b8eb25f4-131e-4582-bbc5-15026f88f42f 2026-02-13T06:00:11.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 b8eb25f4-131e-4582-bbc5-15026f88f42f' 2026-02-13T06:00:11.423 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 b8eb25f4-131e-4582-bbc5-15026f88f42f 2026-02-13T06:00:11.423 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T06:00:11.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDrvY5piFWsGRAArYC5prnA6mL4cggap3lRRA== 2026-02-13T06:00:11.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDrvY5piFWsGRAArYC5prnA6mL4cggap3lRRA=="}' 2026-02-13T06:00:11.432 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b8eb25f4-131e-4582-bbc5-15026f88f42f -i td/test-erasure-eio/3/new.json 2026-02-13T06:00:11.666 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T06:00:11.673 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T06:00:11.674 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDrvY5piFWsGRAArYC5prnA6mL4cggap3lRRA== --osd-uuid b8eb25f4-131e-4582-bbc5-15026f88f42f 2026-02-13T06:00:11.692 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:11.691+0000 7f27bca53900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:11.693 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:11.693+0000 7f27bca53900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:11.694 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:11.693+0000 7f27bca53900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:11.695 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:11.694+0000 7f27bca53900 -1 bdev(0x55ed40042c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T06:00:11.695 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:11.694+0000 7f27bca53900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T06:00:12.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T06:00:12.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T06:00:12.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T06:00:12.011 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T06:00:12.012 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T06:00:12.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T06:00:12.327 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T06:00:12.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:00:12.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T06:00:12.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T06:00:12.328 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T06:00:12.344 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:12.344+0000 7fbc0e93d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:12.346 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:12.345+0000 7fbc0e93d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:12.347 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:12.346+0000 7fbc0e93d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:12.486 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:12.485+0000 7fbc0e93d900 -1 Falling back to public interface 2026-02-13T06:00:12.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T06:00:12.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:00:12.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T06:00:12.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:00:12.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:00:12.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:12.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:00:12.549 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:12.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T06:00:12.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:12.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:00:12.793 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:12.792+0000 7fbc0e93d900 -1 osd.3 0 log_to_monitors true 2026-02-13T06:00:13.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:00:13.777 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:13.777 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:00:13.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:00:13.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:13.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T06:00:14.004 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 25 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/598707705,v1:127.0.0.1:6827/598707705] [v2:127.0.0.1:6828/598707705,v1:127.0.0.1:6829/598707705] exists,up b8eb25f4-131e-4582-bbc5-15026f88f42f 2026-02-13T06:00:14.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:00:14.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:00:14.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:00:14.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T06:00:14.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T06:00:14.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T06:00:14.006 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:14.006 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:14.006 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:14.006 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T06:00:14.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T06:00:14.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T06:00:14.051 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T06:00:14.054 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T06:00:14.056 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T06:00:05.016+0000 7f929b215900 0 load: jerasure load: lrc 2026-02-13T06:00:14.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:305: TEST_rados_get_subread_missing: local poolname=pool-jerasure 2026-02-13T06:00:14.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:306: TEST_rados_get_subread_missing: create_erasure_coded_pool pool-jerasure 2 1 2026-02-13T06:00:14.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T06:00:14.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T06:00:14.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-13T06:00:14.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T06:00:14.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-13T06:00:14.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T06:00:14.058 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-13T06:00:14.342 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T06:00:14.343 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T06:00:14.720 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T06:00:14.728 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T06:00:15.729 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T06:00:15.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T06:00:15.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T06:00:15.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T06:00:15.730 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T06:00:15.731 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T06:00:15.731 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T06:00:15.731 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T06:00:15.731 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T06:00:15.732 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T06:00:15.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T06:00:15.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T06:00:15.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T06:00:15.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T06:00:15.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T06:00:15.819 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T06:00:16.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T06:00:16.040 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:16.040 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T06:00:16.040 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T06:00:16.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T06:00:16.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:16.041 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T06:00:16.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803780 2026-02-13T06:00:16.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803780 2026-02-13T06:00:16.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780' 2026-02-13T06:00:16.108 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:16.108 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T06:00:16.173 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607557 2026-02-13T06:00:16.173 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607557 2026-02-13T06:00:16.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607557' 2026-02-13T06:00:16.174 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:16.174 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T06:00:16.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444036 2026-02-13T06:00:16.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444036 2026-02-13T06:00:16.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607557 2-73014444036' 2026-02-13T06:00:16.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:16.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T06:00:16.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182403 2026-02-13T06:00:16.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182403 2026-02-13T06:00:16.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607557 2-73014444036 3-107374182403' 2026-02-13T06:00:16.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:16.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803780 2026-02-13T06:00:16.306 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:16.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T06:00:16.307 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803780 2026-02-13T06:00:16.308 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:16.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803780 2026-02-13T06:00:16.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803780' 2026-02-13T06:00:16.309 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803780 2026-02-13T06:00:16.309 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:00:16.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803778 -lt 25769803780 2026-02-13T06:00:16.533 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T06:00:17.534 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T06:00:17.534 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:00:17.760 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803780 2026-02-13T06:00:17.761 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:17.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607557 2026-02-13T06:00:17.761 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:17.762 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T06:00:17.763 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607557 2026-02-13T06:00:17.763 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:17.764 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607557 2026-02-13T06:00:17.764 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607557' 2026-02-13T06:00:17.764 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607557 2026-02-13T06:00:17.765 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T06:00:17.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607557 -lt 51539607557 2026-02-13T06:00:17.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:17.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444036 2026-02-13T06:00:17.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:17.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T06:00:17.992 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444036 2026-02-13T06:00:17.993 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:17.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444036 2026-02-13T06:00:17.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444036' 2026-02-13T06:00:17.994 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 73014444036 2026-02-13T06:00:17.994 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T06:00:18.217 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444037 -lt 73014444036 2026-02-13T06:00:18.217 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:18.217 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182403 2026-02-13T06:00:18.218 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:18.218 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T06:00:18.219 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182403 2026-02-13T06:00:18.219 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:18.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182403 2026-02-13T06:00:18.221 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182403' 2026-02-13T06:00:18.221 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 107374182403 2026-02-13T06:00:18.221 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T06:00:18.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182403 -lt 107374182403 2026-02-13T06:00:18.445 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T06:00:18.446 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:00:18.446 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:00:18.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T06:00:18.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T06:00:18.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T06:00:18.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T06:00:18.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T06:00:18.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T06:00:18.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T06:00:18.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T06:00:18.978 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T06:00:18.978 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T06:00:18.978 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:00:18.979 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:00:19.292 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T06:00:19.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T06:00:19.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T06:00:19.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:308: TEST_rados_get_subread_missing: local shard_id=1 2026-02-13T06:00:19.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:309: TEST_rados_get_subread_missing: rados_put_get_data remove td/test-erasure-eio 1 2026-02-13T06:00:19.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=remove 2026-02-13T06:00:19.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-13T06:00:19.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-13T06:00:19.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-13T06:00:19.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=1 2026-02-13T06:00:19.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-13T06:00:19.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg= 2026-02-13T06:00:19.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-13T06:00:19.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-remove-72120-1 2026-02-13T06:00:19.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-remove-72120-1 2026-02-13T06:00:19.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T06:00:19.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T06:00:19.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-remove-72120-1 2026-02-13T06:00:19.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:00:19.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T06:00:19.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:00:19.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T06:00:19.295 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:00:19.295 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T06:00:19.295 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:00:19.295 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T06:00:19.295 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-remove-72120-1 td/test-erasure-eio/ORIGINAL 2026-02-13T06:00:19.313 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_remove ec data pool-jerasure obj-remove-72120-1 td/test-erasure-eio 1 2026-02-13T06:00:19.313 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:127: inject_remove: local pooltype=ec 2026-02-13T06:00:19.313 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:128: inject_remove: shift 2026-02-13T06:00:19.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:129: inject_remove: local which=data 2026-02-13T06:00:19.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:130: inject_remove: shift 2026-02-13T06:00:19.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:131: inject_remove: local poolname=pool-jerasure 2026-02-13T06:00:19.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:132: inject_remove: shift 2026-02-13T06:00:19.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:133: inject_remove: local objname=obj-remove-72120-1 2026-02-13T06:00:19.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:134: inject_remove: shift 2026-02-13T06:00:19.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:135: inject_remove: local dir=td/test-erasure-eio 2026-02-13T06:00:19.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:136: inject_remove: shift 2026-02-13T06:00:19.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:137: inject_remove: local shard_id=1 2026-02-13T06:00:19.314 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:138: inject_remove: shift 2026-02-13T06:00:19.314 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: get_osds pool-jerasure obj-remove-72120-1 2026-02-13T06:00:19.314 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T06:00:19.315 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-remove-72120-1 2026-02-13T06:00:19.315 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-remove-72120-1 2026-02-13T06:00:19.315 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T06:00:19.541 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T06:00:19.541 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:19.541 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T06:00:19.542 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T06:00:19.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: initial_osds=('3' '1' '2') 2026-02-13T06:00:19.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: local -a initial_osds 2026-02-13T06:00:19.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:141: inject_remove: local osd_id=1 2026-02-13T06:00:19.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:142: inject_remove: objectstore_tool td/test-erasure-eio 1 obj-remove-72120-1 remove 2026-02-13T06:00:19.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T06:00:19.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T06:00:19.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-13T06:00:19.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T06:00:19.542 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-remove-72120-1 remove 2026-02-13T06:00:19.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T06:00:19.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T06:00:19.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-13T06:00:19.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T06:00:19.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-13T06:00:19.543 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T06:00:19.543 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T06:00:19.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T06:00:19.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T06:00:19.543 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T06:00:19.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T06:00:19.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-remove-72120-1 remove 2026-02-13T06:00:19.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T06:00:19.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T06:00:19.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T06:00:19.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T06:00:19.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-13T06:00:19.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-remove-72120-1 remove 2026-02-13T06:00:19.944 INFO:tasks.workunit.client.0.trial024.stdout:remove 1#2:58fe7348:::obj-remove-72120-1:head# 2026-02-13T06:00:20.000 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-13T06:00:20.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T06:00:20.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T06:00:20.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T06:00:20.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T06:00:20.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T06:00:20.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:00:20.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:00:20.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:00:20.001 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:00:20.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T06:00:20.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T06:00:20.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T06:00:20.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T06:00:20.002 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:00:20.002 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T06:00:20.002 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:20.002 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:20.002 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:20.002 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:20.002 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:20.002 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:00:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:00:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:00:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:00:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:00:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:00:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:00:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T06:00:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T06:00:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T06:00:20.003 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T06:00:20.004 INFO:tasks.workunit.client.0.trial024.stderr:start osd.1 2026-02-13T06:00:20.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:00:20.004 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-13T06:00:20.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T06:00:20.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T06:00:20.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T06:00:20.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T06:00:20.017 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:20.016+0000 7f86b398c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:20.018 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:20.017+0000 7f86b398c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:20.019 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:20.019+0000 7f86b398c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:20.175 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:20.175+0000 7f86b398c900 -1 Falling back to public interface 2026-02-13T06:00:20.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T06:00:20.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:00:20.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T06:00:20.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:00:20.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:00:20.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:20.228 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:00:20.229 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T06:00:20.229 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:20.229 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T06:00:20.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:00:20.524 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:20.524+0000 7f86b398c900 -1 osd.1 33 log_to_monitors true 2026-02-13T06:00:21.451 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:00:21.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:21.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:00:21.452 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:21.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:21.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T06:00:21.679 INFO:tasks.workunit.client.0.trial024.stderr:osd.1 up in weight 1 up_from 37 up_thru 37 down_at 34 last_clean_interval [12,33) [v2:127.0.0.1:6810/1782810145,v1:127.0.0.1:6811/1782810145] [v2:127.0.0.1:6812/1782810145,v1:127.0.0.1:6813/1782810145] exists,up 30e21a0f-18ff-46b9-9c80-1bb9f804804d 2026-02-13T06:00:21.679 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:00:21.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:00:21.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:00:21.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T06:00:21.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T06:00:21.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T06:00:21.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T06:00:21.680 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T06:00:21.680 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T06:00:21.680 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T06:00:21.680 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T06:00:21.680 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T06:00:21.680 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T06:00:21.765 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T06:00:21.765 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T06:00:21.766 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T06:00:21.766 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T06:00:21.766 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T06:00:21.766 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T06:00:21.988 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T06:00:21.988 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:21.989 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T06:00:21.989 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T06:00:21.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T06:00:21.989 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:21.989 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T06:00:22.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803784 2026-02-13T06:00:22.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803784 2026-02-13T06:00:22.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784' 2026-02-13T06:00:22.052 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:22.052 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T06:00:22.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-13T06:00:22.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-13T06:00:22.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-158913789955' 2026-02-13T06:00:22.117 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:22.117 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T06:00:22.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444040 2026-02-13T06:00:22.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444040 2026-02-13T06:00:22.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-158913789955 2-73014444040' 2026-02-13T06:00:22.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:22.181 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T06:00:22.244 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182406 2026-02-13T06:00:22.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182406 2026-02-13T06:00:22.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-158913789955 2-73014444040 3-107374182406' 2026-02-13T06:00:22.245 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:22.245 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803784 2026-02-13T06:00:22.245 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:22.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T06:00:22.247 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803784 2026-02-13T06:00:22.247 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:22.248 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803784 2026-02-13T06:00:22.248 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803784' 2026-02-13T06:00:22.248 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803784 2026-02-13T06:00:22.248 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:00:22.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803784 2026-02-13T06:00:22.472 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T06:00:23.473 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T06:00:23.473 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:00:23.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803784 -lt 25769803784 2026-02-13T06:00:23.702 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:23.703 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-158913789955 2026-02-13T06:00:23.703 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:23.704 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T06:00:23.704 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-158913789955 2026-02-13T06:00:23.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:23.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789955 2026-02-13T06:00:23.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 158913789955' 2026-02-13T06:00:23.706 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 158913789955 2026-02-13T06:00:23.706 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T06:00:23.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789955 -lt 158913789955 2026-02-13T06:00:23.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:23.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-73014444040 2026-02-13T06:00:23.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:23.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T06:00:23.934 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-73014444040 2026-02-13T06:00:23.934 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:23.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=73014444040 2026-02-13T06:00:23.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 73014444040' 2026-02-13T06:00:23.935 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 73014444040 2026-02-13T06:00:23.936 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T06:00:24.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 73014444040 -lt 73014444040 2026-02-13T06:00:24.160 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:24.161 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182406 2026-02-13T06:00:24.161 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:24.162 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T06:00:24.162 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182406 2026-02-13T06:00:24.163 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:24.163 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182406 2026-02-13T06:00:24.164 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182406' 2026-02-13T06:00:24.164 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 107374182406 2026-02-13T06:00:24.164 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T06:00:24.391 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182406 -lt 107374182406 2026-02-13T06:00:24.391 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T06:00:24.391 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:00:24.392 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:00:24.707 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T06:00:24.708 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T06:00:24.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T06:00:24.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T06:00:24.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T06:00:24.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T06:00:24.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T06:00:24.708 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T06:00:24.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T06:00:24.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T06:00:24.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:00:24.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:00:25.246 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T06:00:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T06:00:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T06:00:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-remove-72120-1 2026-02-13T06:00:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T06:00:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T06:00:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-remove-72120-1 2026-02-13T06:00:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T06:00:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T06:00:25.247 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-remove-72120-1 td/test-erasure-eio/COPY 2026-02-13T06:00:25.265 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T06:00:25.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T06:00:25.267 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' '' = recovery ']' 2026-02-13T06:00:25.267 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: expr 1 + 1 2026-02-13T06:00:25.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: local another_shard_id=2 2026-02-13T06:00:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:182: rados_put_get_data: inject_remove ec data pool-jerasure obj-remove-72120-1 td/test-erasure-eio 2 2026-02-13T06:00:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:127: inject_remove: local pooltype=ec 2026-02-13T06:00:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:128: inject_remove: shift 2026-02-13T06:00:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:129: inject_remove: local which=data 2026-02-13T06:00:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:130: inject_remove: shift 2026-02-13T06:00:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:131: inject_remove: local poolname=pool-jerasure 2026-02-13T06:00:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:132: inject_remove: shift 2026-02-13T06:00:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:133: inject_remove: local objname=obj-remove-72120-1 2026-02-13T06:00:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:134: inject_remove: shift 2026-02-13T06:00:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:135: inject_remove: local dir=td/test-erasure-eio 2026-02-13T06:00:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:136: inject_remove: shift 2026-02-13T06:00:25.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:137: inject_remove: local shard_id=2 2026-02-13T06:00:25.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:138: inject_remove: shift 2026-02-13T06:00:25.271 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: get_osds pool-jerasure obj-remove-72120-1 2026-02-13T06:00:25.271 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T06:00:25.271 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-remove-72120-1 2026-02-13T06:00:25.271 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-remove-72120-1 2026-02-13T06:00:25.271 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T06:00:25.494 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T06:00:25.494 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:25.494 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T06:00:25.494 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T06:00:25.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: initial_osds=('3' '1' '2') 2026-02-13T06:00:25.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: local -a initial_osds 2026-02-13T06:00:25.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:141: inject_remove: local osd_id=2 2026-02-13T06:00:25.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:142: inject_remove: objectstore_tool td/test-erasure-eio 2 obj-remove-72120-1 remove 2026-02-13T06:00:25.494 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/test-erasure-eio 2026-02-13T06:00:25.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-13T06:00:25.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-13T06:00:25.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-13T06:00:25.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-remove-72120-1 remove 2026-02-13T06:00:25.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-13T06:00:25.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-13T06:00:25.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-13T06:00:25.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-13T06:00:25.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-13T06:00:25.495 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T06:00:25.495 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T06:00:25.495 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T06:00:25.496 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T06:00:25.496 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T06:00:25.801 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T06:00:25.801 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-remove-72120-1 remove 2026-02-13T06:00:25.801 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-13T06:00:25.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T06:00:25.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-13T06:00:25.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T06:00:25.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-13T06:00:25.802 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-remove-72120-1 remove 2026-02-13T06:00:25.903 INFO:tasks.workunit.client.0.trial024.stdout:remove 2#2:58fe7348:::obj-remove-72120-1:head# 2026-02-13T06:00:25.945 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-13T06:00:25.945 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T06:00:25.945 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T06:00:25.945 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T06:00:25.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T06:00:25.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T06:00:25.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:00:25.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:00:25.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:00:25.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:00:25.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T06:00:25.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T06:00:25.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T06:00:25.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:00:25.947 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:00:25.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:00:25.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:00:25.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:00:25.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T06:00:25.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T06:00:25.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T06:00:25.948 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T06:00:25.948 INFO:tasks.workunit.client.0.trial024.stderr:start osd.2 2026-02-13T06:00:25.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:00:25.950 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-13T06:00:25.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T06:00:25.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T06:00:25.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T06:00:25.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T06:00:25.961 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:25.960+0000 7fb0d61d8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:25.963 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:25.961+0000 7fb0d61d8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:25.964 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:25.962+0000 7fb0d61d8900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:26.149 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:26.147+0000 7fb0d61d8900 -1 Falling back to public interface 2026-02-13T06:00:26.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T06:00:26.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:00:26.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T06:00:26.175 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:00:26.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:00:26.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:26.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:00:26.176 INFO:tasks.workunit.client.0.trial024.stderr:0 2026-02-13T06:00:26.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:26.176 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T06:00:26.400 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:00:26.511 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:26.509+0000 7fb0d61d8900 -1 osd.2 40 log_to_monitors true 2026-02-13T06:00:27.402 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:00:27.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:27.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:00:27.403 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:27.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:27.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T06:00:27.634 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 up in weight 1 up_from 43 up_thru 34 down_at 40 last_clean_interval [17,40) [v2:127.0.0.1:6818/2930785574,v1:127.0.0.1:6819/2930785574] [v2:127.0.0.1:6820/2930785574,v1:127.0.0.1:6821/2930785574] exists,up af9cf217-abc5-4c3e-8204-95a1b53474b5 2026-02-13T06:00:27.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:00:27.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:00:27.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:00:27.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-13T06:00:27.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T06:00:27.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T06:00:27.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T06:00:27.635 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T06:00:27.635 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T06:00:27.635 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T06:00:27.635 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T06:00:27.636 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T06:00:27.636 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T06:00:27.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T06:00:27.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T06:00:27.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T06:00:27.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T06:00:27.721 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T06:00:27.721 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T06:00:27.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T06:00:27.946 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:27.946 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T06:00:27.946 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T06:00:27.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T06:00:27.946 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:27.946 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T06:00:28.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803787 2026-02-13T06:00:28.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803787 2026-02-13T06:00:28.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787' 2026-02-13T06:00:28.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:28.011 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T06:00:28.073 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789958 2026-02-13T06:00:28.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789958 2026-02-13T06:00:28.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787 1-158913789958' 2026-02-13T06:00:28.074 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:28.074 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T06:00:28.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593731 2026-02-13T06:00:28.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593731 2026-02-13T06:00:28.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787 1-158913789958 2-184683593731' 2026-02-13T06:00:28.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:28.138 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T06:00:28.201 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182409 2026-02-13T06:00:28.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182409 2026-02-13T06:00:28.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803787 1-158913789958 2-184683593731 3-107374182409' 2026-02-13T06:00:28.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:28.202 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803787 2026-02-13T06:00:28.203 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:28.203 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T06:00:28.204 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803787 2026-02-13T06:00:28.204 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:28.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803787 2026-02-13T06:00:28.205 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803787' 2026-02-13T06:00:28.205 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.0 seq 25769803787 2026-02-13T06:00:28.205 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:00:28.437 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803785 -lt 25769803787 2026-02-13T06:00:28.437 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T06:00:29.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T06:00:29.439 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:00:29.667 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803787 -lt 25769803787 2026-02-13T06:00:29.667 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:29.668 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-158913789958 2026-02-13T06:00:29.668 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:29.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T06:00:29.669 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-158913789958 2026-02-13T06:00:29.670 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:29.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789958 2026-02-13T06:00:29.671 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 158913789958' 2026-02-13T06:00:29.671 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.1 seq 158913789958 2026-02-13T06:00:29.671 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T06:00:29.896 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789958 -lt 158913789958 2026-02-13T06:00:29.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:29.897 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-184683593731 2026-02-13T06:00:29.897 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:29.898 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T06:00:29.899 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-184683593731 2026-02-13T06:00:29.899 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:29.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=184683593731 2026-02-13T06:00:29.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 184683593731' 2026-02-13T06:00:29.900 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.2 seq 184683593731 2026-02-13T06:00:29.900 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T06:00:30.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 184683593731 -lt 184683593731 2026-02-13T06:00:30.125 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:30.126 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-107374182409 2026-02-13T06:00:30.126 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:30.127 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T06:00:30.128 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-107374182409 2026-02-13T06:00:30.128 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:30.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=107374182409 2026-02-13T06:00:30.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 107374182409' 2026-02-13T06:00:30.129 INFO:tasks.workunit.client.0.trial024.stderr:waiting osd.3 seq 107374182409 2026-02-13T06:00:30.129 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T06:00:30.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 107374182410 -lt 107374182409 2026-02-13T06:00:30.355 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T06:00:30.356 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:00:30.356 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:00:30.668 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T06:00:30.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T06:00:30.669 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T06:00:30.670 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T06:00:30.670 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T06:00:30.670 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T06:00:30.670 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T06:00:30.670 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T06:00:30.897 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T06:00:30.898 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T06:00:30.898 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:00:30.898 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:00:31.212 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T06:00:31.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T06:00:31.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T06:00:31.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:183: rados_put_get_data: '[' 1 -eq 1 -a 2 -eq 2 ']' 2026-02-13T06:00:31.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:188: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-remove-72120-1 2026-02-13T06:00:31.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T06:00:31.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T06:00:31.213 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-remove-72120-1 2026-02-13T06:00:31.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T06:00:31.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T06:00:31.214 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-remove-72120-1 td/test-erasure-eio/COPY 2026-02-13T06:00:31.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T06:00:31.231 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T06:00:31.232 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: rados_put_get_data: rm td/test-erasure-eio/ORIGINAL 2026-02-13T06:00:31.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:310: TEST_rados_get_subread_missing: delete_erasure_coded_pool pool-jerasure 2026-02-13T06:00:31.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T06:00:31.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T06:00:31.504 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T06:00:31.512 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T06:00:31.789 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T06:00:31.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T06:00:31.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T06:00:31.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T06:00:31.798 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T06:00:31.799 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T06:00:31.799 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T06:00:31.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T06:00:31.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T06:00:31.799 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T06:00:31.907 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T06:00:31.907 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T06:00:31.908 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T06:00:31.908 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T06:00:31.910 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T06:00:31.910 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T06:00:31.910 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T06:00:31.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:00:31.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T06:00:31.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T06:00:31.911 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:00:31.912 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T06:00:31.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T06:00:31.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T06:00:31.924 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T06:00:31.924 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:31.924 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:31.924 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T06:00:31.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T06:00:31.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T06:00:31.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T06:00:31.926 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T06:00:31.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T06:00:31.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T06:00:31.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T06:00:31.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T06:00:31.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T06:00:31.927 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T06:00:31.927 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T06:00:31.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T06:00:31.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T06:00:31.927 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T06:00:31.928 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T06:00:31.928 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T06:00:31.929 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T06:00:31.929 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T06:00:31.930 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T06:00:31.930 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T06:00:31.931 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T06:00:31.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:00:31.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T06:00:31.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T06:00:31.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:00:31.933 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T06:00:31.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T06:00:31.934 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T06:00:31.935 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T06:00:31.935 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:31.935 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:31.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T06:00:31.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T06:00:31.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T06:00:31.936 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T06:00:31.937 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T06:00:31.937 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:31.938 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:31.938 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T06:00:31.938 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T06:00:31.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T06:00:31.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T06:00:31.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T06:00:31.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T06:00:31.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T06:00:31.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T06:00:31.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T06:00:31.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T06:00:31.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T06:00:31.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T06:00:31.960 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T06:00:31.960 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:31.961 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:31.961 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:31.961 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:31.961 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:31.961 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:31.961 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T06:00:31.987 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T06:00:31.988 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T06:00:31.989 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T06:00:31.989 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T06:00:31.989 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T06:00:31.989 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T06:00:31.990 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T06:00:31.990 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T06:00:31.990 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T06:00:31.990 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:31.990 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:31.990 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:31.991 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T06:00:31.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T06:00:31.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T06:00:32.035 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T06:00:32.036 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T06:00:32.036 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T06:00:32.036 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T06:00:32.036 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T06:00:32.037 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T06:00:32.037 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T06:00:32.037 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T06:00:32.037 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:32.037 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:32.038 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:32.038 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T06:00:32.038 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T06:00:32.038 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T06:00:32.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T06:00:32.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T06:00:32.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T06:00:32.082 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T06:00:32.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T06:00:32.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T06:00:32.083 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T06:00:32.183 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T06:00:32.183 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:32.183 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:32.183 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:32.183 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:32.183 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:32.184 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:32.184 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T06:00:32.185 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T06:00:32.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T06:00:32.202 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T06:00:32.300 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T06:00:32.306 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T06:00:33.309 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T06:00:33.309 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T06:00:33.309 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T06:00:33.309 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:33.309 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:33.309 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:33.309 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T06:00:33.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T06:00:33.310 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T06:00:33.351 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T06:00:33.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T06:00:33.357 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T06:00:31.978+0000 7f9e7d80dd80 0 load: jerasure load: lrc 2026-02-13T06:00:33.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_with_subreadall_eio_shard_0 td/test-erasure-eio 2026-02-13T06:00:33.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:350: TEST_rados_get_with_subreadall_eio_shard_0: local dir=td/test-erasure-eio 2026-02-13T06:00:33.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:351: TEST_rados_get_with_subreadall_eio_shard_0: local shard_id=0 2026-02-13T06:00:33.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:353: TEST_rados_get_with_subreadall_eio_shard_0: setup_osds 4 2026-02-13T06:00:33.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-13T06:00:33.358 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T06:00:33.358 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-13T06:00:33.362 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-13T06:00:33.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T06:00:33.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T06:00:33.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T06:00:33.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T06:00:33.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T06:00:33.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T06:00:33.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T06:00:33.362 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:00:33.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:00:33.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:00:33.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:00:33.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T06:00:33.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T06:00:33.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T06:00:33.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T06:00:33.363 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:00:33.363 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T06:00:33.363 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:33.363 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:33.363 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:33.364 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:33.364 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:33.364 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:33.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:33.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:00:33.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T06:00:33.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T06:00:33.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:00:33.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:00:33.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:00:33.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:00:33.364 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:00:33.365 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:00:33.365 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T06:00:33.365 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T06:00:33.365 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T06:00:33.365 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T06:00:33.365 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=abf0ba05-5bc8-4483-bcaf-bceff9ab1241 2026-02-13T06:00:33.365 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 abf0ba05-5bc8-4483-bcaf-bceff9ab1241' 2026-02-13T06:00:33.365 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 abf0ba05-5bc8-4483-bcaf-bceff9ab1241 2026-02-13T06:00:33.366 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T06:00:33.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQABvo5p/Jw4FhAAfgVWIksAFdLLXebQU4wTTg== 2026-02-13T06:00:33.373 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQABvo5p/Jw4FhAAfgVWIksAFdLLXebQU4wTTg=="}' 2026-02-13T06:00:33.374 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new abf0ba05-5bc8-4483-bcaf-bceff9ab1241 -i td/test-erasure-eio/0/new.json 2026-02-13T06:00:33.480 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:33.487 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T06:00:33.487 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQABvo5p/Jw4FhAAfgVWIksAFdLLXebQU4wTTg== --osd-uuid abf0ba05-5bc8-4483-bcaf-bceff9ab1241 2026-02-13T06:00:33.505 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:33.503+0000 7f3a49be0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:33.506 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:33.505+0000 7f3a49be0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:33.507 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:33.506+0000 7f3a49be0900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:33.508 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:33.506+0000 7f3a49be0900 -1 bdev(0x55ebc938ec00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T06:00:33.508 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:33.506+0000 7f3a49be0900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T06:00:33.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T06:00:33.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T06:00:33.890 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T06:00:33.890 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T06:00:33.890 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T06:00:33.994 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T06:00:33.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T06:00:33.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:00:33.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T06:00:33.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T06:00:33.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T06:00:34.013 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:34.011+0000 7f7b9ac62900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:34.014 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:34.012+0000 7f7b9ac62900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:34.015 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:34.013+0000 7f7b9ac62900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:34.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T06:00:34.095 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:00:34.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T06:00:34.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:00:34.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:00:34.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:34.096 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:00:34.096 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:34.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:34.097 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T06:00:34.193 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:00:34.212 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:34.210+0000 7f7b9ac62900 -1 Falling back to public interface 2026-02-13T06:00:34.483 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:34.481+0000 7f7b9ac62900 -1 osd.0 0 log_to_monitors true 2026-02-13T06:00:35.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:00:35.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:35.195 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:00:35.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:00:35.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:35.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T06:00:35.420 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3954714221,v1:127.0.0.1:6801/3954714221] [v2:127.0.0.1:6802/3954714221,v1:127.0.0.1:6803/3954714221] exists,up abf0ba05-5bc8-4483-bcaf-bceff9ab1241 2026-02-13T06:00:35.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:00:35.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:00:35.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:00:35.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T06:00:35.423 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T06:00:35.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T06:00:35.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T06:00:35.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T06:00:35.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T06:00:35.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T06:00:35.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:00:35.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:00:35.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:00:35.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:00:35.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T06:00:35.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T06:00:35.424 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T06:00:35.425 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T06:00:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:00:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:00:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:00:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:00:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:00:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:00:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T06:00:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T06:00:35.426 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T06:00:35.426 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T06:00:35.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=642c5658-29d8-4678-81d0-e753e814d7e1 2026-02-13T06:00:35.427 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 642c5658-29d8-4678-81d0-e753e814d7e1' 2026-02-13T06:00:35.427 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 642c5658-29d8-4678-81d0-e753e814d7e1 2026-02-13T06:00:35.428 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T06:00:35.436 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQADvo5pGAv2GRAAl2rPdW2+S94h9dYLqunN9w== 2026-02-13T06:00:35.436 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQADvo5pGAv2GRAAl2rPdW2+S94h9dYLqunN9w=="}' 2026-02-13T06:00:35.436 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 642c5658-29d8-4678-81d0-e753e814d7e1 -i td/test-erasure-eio/1/new.json 2026-02-13T06:00:35.668 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:00:35.677 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T06:00:35.678 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQADvo5pGAv2GRAAl2rPdW2+S94h9dYLqunN9w== --osd-uuid 642c5658-29d8-4678-81d0-e753e814d7e1 2026-02-13T06:00:35.696 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:35.694+0000 7f1051012900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:35.697 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:35.696+0000 7f1051012900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:35.698 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:35.697+0000 7f1051012900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:35.699 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:35.697+0000 7f1051012900 -1 bdev(0x562cff194c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T06:00:35.699 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:35.697+0000 7f1051012900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T06:00:36.026 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T06:00:36.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T06:00:36.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T06:00:36.028 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T06:00:36.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T06:00:36.346 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T06:00:36.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T06:00:36.347 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:00:36.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T06:00:36.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T06:00:36.348 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T06:00:36.363 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:36.361+0000 7f7d0ed49900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:36.365 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:36.363+0000 7f7d0ed49900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:36.366 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:36.364+0000 7f7d0ed49900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:36.505 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:36.503+0000 7f7d0ed49900 -1 Falling back to public interface 2026-02-13T06:00:36.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T06:00:36.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:00:36.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T06:00:36.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:00:36.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:00:36.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:36.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:00:36.580 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:36.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:36.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T06:00:36.795 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:36.793+0000 7f7d0ed49900 -1 osd.1 0 log_to_monitors true 2026-02-13T06:00:36.805 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:00:37.806 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:00:37.806 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:37.807 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:00:37.807 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:00:37.807 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:37.807 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T06:00:38.034 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1529117497,v1:127.0.0.1:6811/1529117497] [v2:127.0.0.1:6812/1529117497,v1:127.0.0.1:6813/1529117497] exists,up 642c5658-29d8-4678-81d0-e753e814d7e1 2026-02-13T06:00:38.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:00:38.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:00:38.037 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:00:38.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T06:00:38.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T06:00:38.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T06:00:38.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T06:00:38.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T06:00:38.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T06:00:38.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T06:00:38.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:00:38.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:00:38.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:00:38.038 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:00:38.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T06:00:38.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T06:00:38.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T06:00:38.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T06:00:38.039 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:00:38.039 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T06:00:38.039 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:38.039 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:38.039 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:38.039 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:38.039 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:38.039 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T06:00:38.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T06:00:38.041 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T06:00:38.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ac3415d5-31f1-40d0-9159-f6f75ed44883 2026-02-13T06:00:38.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 ac3415d5-31f1-40d0-9159-f6f75ed44883' 2026-02-13T06:00:38.042 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 ac3415d5-31f1-40d0-9159-f6f75ed44883 2026-02-13T06:00:38.042 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T06:00:38.050 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAGvo5pJIPvAhAAV7BBu3WTXb0Rd9bAuawSfQ== 2026-02-13T06:00:38.050 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAGvo5pJIPvAhAAV7BBu3WTXb0Rd9bAuawSfQ=="}' 2026-02-13T06:00:38.050 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ac3415d5-31f1-40d0-9159-f6f75ed44883 -i td/test-erasure-eio/2/new.json 2026-02-13T06:00:38.277 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T06:00:38.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T06:00:38.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAGvo5pJIPvAhAAV7BBu3WTXb0Rd9bAuawSfQ== --osd-uuid ac3415d5-31f1-40d0-9159-f6f75ed44883 2026-02-13T06:00:38.304 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:38.302+0000 7fa65de0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:38.305 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:38.304+0000 7fa65de0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:38.306 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:38.305+0000 7fa65de0d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:38.307 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:38.305+0000 7fa65de0d900 -1 bdev(0x55a171da0c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T06:00:38.307 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:38.305+0000 7fa65de0d900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T06:00:38.639 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T06:00:38.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T06:00:38.640 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T06:00:38.641 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T06:00:38.641 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T06:00:38.956 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T06:00:38.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T06:00:38.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:00:38.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T06:00:38.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T06:00:38.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T06:00:38.973 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:38.972+0000 7f4d7c956900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:38.975 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:38.973+0000 7f4d7c956900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:38.976 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:38.975+0000 7f4d7c956900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:39.127 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:39.126+0000 7f4d7c956900 -1 Falling back to public interface 2026-02-13T06:00:39.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T06:00:39.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:00:39.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T06:00:39.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:00:39.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:00:39.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:39.181 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:00:39.181 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:39.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:39.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T06:00:39.403 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:00:39.476 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:39.476+0000 7f4d7c956900 -1 osd.2 0 log_to_monitors true 2026-02-13T06:00:40.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:00:40.405 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:40.406 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:00:40.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:00:40.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:40.406 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T06:00:40.639 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2983411790,v1:127.0.0.1:6819/2983411790] [v2:127.0.0.1:6820/2983411790,v1:127.0.0.1:6821/2983411790] exists,up ac3415d5-31f1-40d0-9159-f6f75ed44883 2026-02-13T06:00:40.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:00:40.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:00:40.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:00:40.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T06:00:40.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T06:00:40.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T06:00:40.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T06:00:40.643 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T06:00:40.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T06:00:40.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T06:00:40.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:00:40.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:00:40.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:00:40.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:00:40.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T06:00:40.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T06:00:40.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T06:00:40.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T06:00:40.644 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:00:40.644 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T06:00:40.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:40.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:40.645 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:40.645 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:40.645 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:40.645 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:40.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:40.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:00:40.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T06:00:40.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T06:00:40.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:00:40.645 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:00:40.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:00:40.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:00:40.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:00:40.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:00:40.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T06:00:40.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T06:00:40.646 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T06:00:40.646 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T06:00:40.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=35e827ea-fbf3-4884-81f3-dd90a4c796bc 2026-02-13T06:00:40.647 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 35e827ea-fbf3-4884-81f3-dd90a4c796bc 2026-02-13T06:00:40.647 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 35e827ea-fbf3-4884-81f3-dd90a4c796bc' 2026-02-13T06:00:40.647 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T06:00:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAIvo5pnsQNJxAAOlyXEluk0VBTMon9610Ojw== 2026-02-13T06:00:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAIvo5pnsQNJxAAOlyXEluk0VBTMon9610Ojw=="}' 2026-02-13T06:00:40.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 35e827ea-fbf3-4884-81f3-dd90a4c796bc -i td/test-erasure-eio/3/new.json 2026-02-13T06:00:40.883 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T06:00:40.890 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T06:00:40.891 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAIvo5pnsQNJxAAOlyXEluk0VBTMon9610Ojw== --osd-uuid 35e827ea-fbf3-4884-81f3-dd90a4c796bc 2026-02-13T06:00:40.910 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:40.910+0000 7f2e69e0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:40.912 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:40.911+0000 7f2e69e0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:40.913 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:40.912+0000 7f2e69e0c900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:40.913 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:40.913+0000 7f2e69e0c900 -1 bdev(0x55c949418c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T06:00:40.914 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:40.913+0000 7f2e69e0c900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T06:00:41.234 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T06:00:41.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T06:00:41.235 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T06:00:41.236 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T06:00:41.236 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T06:00:41.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T06:00:41.550 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T06:00:41.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:00:41.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T06:00:41.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T06:00:41.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T06:00:41.567 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:41.567+0000 7f599a4d5900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:41.569 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:41.568+0000 7f599a4d5900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:41.570 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:41.569+0000 7f599a4d5900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:41.710 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:41.709+0000 7f599a4d5900 -1 Falling back to public interface 2026-02-13T06:00:41.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T06:00:41.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:00:41.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T06:00:41.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:00:41.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:00:41.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:41.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:00:41.775 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:41.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:41.775 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T06:00:42.004 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:00:42.021 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:42.020+0000 7f599a4d5900 -1 osd.3 0 log_to_monitors true 2026-02-13T06:00:43.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:00:43.005 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:43.006 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:00:43.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:00:43.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:43.006 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T06:00:43.232 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 27 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/955742245,v1:127.0.0.1:6827/955742245] [v2:127.0.0.1:6828/955742245,v1:127.0.0.1:6829/955742245] exists,up 35e827ea-fbf3-4884-81f3-dd90a4c796bc 2026-02-13T06:00:43.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:00:43.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:00:43.233 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:00:43.233 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T06:00:43.233 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T06:00:43.233 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T06:00:43.234 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:43.234 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:43.234 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:43.234 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T06:00:43.234 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T06:00:43.234 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T06:00:43.278 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T06:00:43.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T06:00:43.285 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T06:00:34.213+0000 7f7b9ac62900 0 load: jerasure load: lrc 2026-02-13T06:00:43.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:355: TEST_rados_get_with_subreadall_eio_shard_0: local poolname=pool-jerasure 2026-02-13T06:00:43.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:356: TEST_rados_get_with_subreadall_eio_shard_0: create_erasure_coded_pool pool-jerasure 2 1 2026-02-13T06:00:43.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T06:00:43.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T06:00:43.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-13T06:00:43.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T06:00:43.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-13T06:00:43.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T06:00:43.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-13T06:00:43.571 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T06:00:43.572 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T06:00:43.941 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T06:00:43.949 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T06:00:44.950 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T06:00:44.951 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T06:00:44.951 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T06:00:44.951 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T06:00:44.951 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T06:00:44.952 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T06:00:44.952 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T06:00:44.953 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T06:00:44.953 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T06:00:44.953 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T06:00:45.040 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T06:00:45.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T06:00:45.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T06:00:45.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T06:00:45.041 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T06:00:45.041 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T06:00:45.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T06:00:45.266 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:45.266 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T06:00:45.266 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T06:00:45.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T06:00:45.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:45.267 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T06:00:45.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803780 2026-02-13T06:00:45.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803780 2026-02-13T06:00:45.330 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780' 2026-02-13T06:00:45.331 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:45.331 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T06:00:45.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607556 2026-02-13T06:00:45.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607556 2026-02-13T06:00:45.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607556' 2026-02-13T06:00:45.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:45.396 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T06:00:45.460 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411331 2026-02-13T06:00:45.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411331 2026-02-13T06:00:45.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607556 2-77309411331' 2026-02-13T06:00:45.461 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:45.461 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T06:00:45.525 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116995 2026-02-13T06:00:45.525 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116995 2026-02-13T06:00:45.525 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-51539607556 2-77309411331 3-115964116995' 2026-02-13T06:00:45.525 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:45.526 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803780 2026-02-13T06:00:45.526 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:45.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T06:00:45.527 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803780 2026-02-13T06:00:45.527 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:45.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803780 2026-02-13T06:00:45.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803780' 2026-02-13T06:00:45.529 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803780 2026-02-13T06:00:45.529 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:00:45.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803778 -lt 25769803780 2026-02-13T06:00:45.753 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T06:00:46.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T06:00:46.754 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:00:46.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803780 2026-02-13T06:00:46.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:46.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607556 2026-02-13T06:00:46.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:46.992 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T06:00:46.992 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607556 2026-02-13T06:00:46.993 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:46.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607556 2026-02-13T06:00:46.994 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607556' 2026-02-13T06:00:46.994 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607556 2026-02-13T06:00:46.994 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T06:00:47.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607556 -lt 51539607556 2026-02-13T06:00:47.222 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:47.223 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411331 2026-02-13T06:00:47.223 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:47.223 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T06:00:47.224 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411331 2026-02-13T06:00:47.224 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:47.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411331 2026-02-13T06:00:47.225 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411331' 2026-02-13T06:00:47.226 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 77309411331 2026-02-13T06:00:47.226 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T06:00:47.449 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411332 -lt 77309411331 2026-02-13T06:00:47.449 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:47.449 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116995 2026-02-13T06:00:47.449 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:47.450 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T06:00:47.451 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116995 2026-02-13T06:00:47.451 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:47.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116995 2026-02-13T06:00:47.452 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116995' 2026-02-13T06:00:47.452 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 115964116995 2026-02-13T06:00:47.452 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T06:00:47.680 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116995 -lt 115964116995 2026-02-13T06:00:47.681 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T06:00:47.681 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:00:47.681 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:00:47.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T06:00:47.990 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T06:00:47.990 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T06:00:47.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T06:00:47.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T06:00:47.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T06:00:47.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T06:00:47.991 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T06:00:48.211 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T06:00:48.211 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T06:00:48.212 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:00:48.212 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:00:48.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T06:00:48.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T06:00:48.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T06:00:48.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:358: TEST_rados_get_with_subreadall_eio_shard_0: rados_put_get_data eio td/test-erasure-eio 0 recovery 2026-02-13T06:00:48.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=eio 2026-02-13T06:00:48.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-13T06:00:48.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-13T06:00:48.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-13T06:00:48.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=0 2026-02-13T06:00:48.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-13T06:00:48.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg=recovery 2026-02-13T06:00:48.530 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-13T06:00:48.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-eio-72120-0 2026-02-13T06:00:48.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-eio-72120-0 2026-02-13T06:00:48.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T06:00:48.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T06:00:48.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-eio-72120-0 2026-02-13T06:00:48.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:00:48.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T06:00:48.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:00:48.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T06:00:48.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:00:48.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T06:00:48.531 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:00:48.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T06:00:48.532 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-eio-72120-0 td/test-erasure-eio/ORIGINAL 2026-02-13T06:00:48.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-72120-0 td/test-erasure-eio 0 2026-02-13T06:00:48.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T06:00:48.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T06:00:48.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T06:00:48.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T06:00:48.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T06:00:48.550 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T06:00:48.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj-eio-72120-0 2026-02-13T06:00:48.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T06:00:48.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T06:00:48.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T06:00:48.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-13T06:00:48.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T06:00:48.551 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj-eio-72120-0 2026-02-13T06:00:48.551 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T06:00:48.551 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72120-0 2026-02-13T06:00:48.551 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72120-0 2026-02-13T06:00:48.551 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T06:00:48.774 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T06:00:48.774 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:48.774 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T06:00:48.774 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T06:00:48.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '2') 2026-02-13T06:00:48.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T06:00:48.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=3 2026-02-13T06:00:48.774 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T06:00:48.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/3/type 2026-02-13T06:00:48.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T06:00:48.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-13T06:00:48.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T06:00:48.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=3 2026-02-13T06:00:48.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T06:00:48.776 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T06:00:48.776 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T06:00:48.777 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.3 2026-02-13T06:00:48.777 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T06:00:48.777 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T06:00:48.778 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:48.778 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:48.778 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:48.778 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T06:00:48.778 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-13T06:00:48.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T06:00:48.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T06:00:48.828 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T06:00:48.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.3 2026-02-13T06:00:48.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.3 2026-02-13T06:00:48.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.3 ']' 2026-02-13T06:00:48.830 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:48.830 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:48.830 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:48.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.3.asok 2026-02-13T06:00:48.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T06:00:48.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.3.asok injectdataerr pool-jerasure obj-eio-72120-0 0 2026-02-13T06:00:48.879 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-72120-0 2026-02-13T06:00:48.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T06:00:48.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T06:00:48.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-72120-0 2026-02-13T06:00:48.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T06:00:48.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T06:00:48.880 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-72120-0 td/test-erasure-eio/COPY 2026-02-13T06:00:48.899 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T06:00:48.900 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T06:00:48.901 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' recovery = recovery ']' 2026-02-13T06:00:48.901 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: get_osds pool-jerasure obj-eio-72120-0 2026-02-13T06:00:48.901 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T06:00:48.902 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72120-0 2026-02-13T06:00:48.902 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72120-0 2026-02-13T06:00:48.902 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T06:00:49.132 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T06:00:49.133 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:49.133 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T06:00:49.133 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T06:00:49.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: initial_osds=('3' '1' '2') 2026-02-13T06:00:49.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: local -a initial_osds 2026-02-13T06:00:49.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:171: rados_put_get_data: local last_osd=2 2026-02-13T06:00:49.133 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:173: rados_put_get_data: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-13T06:00:49.134 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T06:00:49.134 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T06:00:49.134 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T06:00:49.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T06:00:49.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T06:00:49.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T06:00:49.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:174: rados_put_get_data: ceph osd out 2 2026-02-13T06:00:49.542 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 is already out. 2026-02-13T06:00:49.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:175: rados_put_get_data: get_osds pool-jerasure obj-eio-72120-0 2026-02-13T06:00:49.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:175: rados_put_get_data: grep '\<2\>' 2026-02-13T06:00:49.551 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T06:00:49.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72120-0 2026-02-13T06:00:49.552 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72120-0 2026-02-13T06:00:49.552 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T06:00:49.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T06:00:49.788 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:49.788 INFO:tasks.workunit.client.0.trial024.stderr:0' 2026-02-13T06:00:49.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 0 2026-02-13T06:00:49.788 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:176: rados_put_get_data: ceph osd in 2 2026-02-13T06:00:50.065 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 is already in. 2026-02-13T06:00:50.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:177: rados_put_get_data: activate_osd td/test-erasure-eio 2 2026-02-13T06:00:50.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T06:00:50.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T06:00:50.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T06:00:50.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T06:00:50.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T06:00:50.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:00:50.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:00:50.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:00:50.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:00:50.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T06:00:50.077 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T06:00:50.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T06:00:50.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T06:00:50.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:00:50.078 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T06:00:50.078 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:50.078 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:50.078 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:50.078 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:50.078 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:50.078 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:50.078 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:50.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:00:50.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:00:50.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:00:50.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:00:50.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:00:50.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:00:50.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:00:50.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T06:00:50.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T06:00:50.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T06:00:50.079 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T06:00:50.080 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T06:00:50.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:00:50.081 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-13T06:00:50.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T06:00:50.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T06:00:50.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T06:00:50.081 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T06:00:50.094 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:50.093+0000 7f43e474f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:50.095 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:50.095+0000 7f43e474f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:50.096 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:50.096+0000 7f43e474f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:50.236 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:50.236+0000 7f43e474f900 -1 Falling back to public interface 2026-02-13T06:00:50.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T06:00:50.303 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:00:50.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T06:00:50.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:00:50.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:00:50.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:50.304 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:00:50.304 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:50.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:50.305 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T06:00:50.527 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:00:50.544 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:50.544+0000 7f43e474f900 -1 osd.2 35 log_to_monitors true 2026-02-13T06:00:51.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:00:51.528 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:51.529 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:00:51.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:00:51.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:51.529 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T06:00:51.752 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 44 up_thru 20 down_at 36 last_clean_interval [18,35) [v2:127.0.0.1:6818/1129562599,v1:127.0.0.1:6819/1129562599] [v2:127.0.0.1:6820/1129562599,v1:127.0.0.1:6821/1129562599] exists,up ac3415d5-31f1-40d0-9159-f6f75ed44883 2026-02-13T06:00:51.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:00:51.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:00:51.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:00:51.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:178: rados_put_get_data: wait_for_clean 2026-02-13T06:00:51.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T06:00:51.754 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T06:00:51.755 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T06:00:51.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T06:00:51.755 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T06:00:51.755 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T06:00:51.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T06:00:51.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T06:00:51.755 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T06:00:51.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T06:00:51.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T06:00:51.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T06:00:51.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T06:00:51.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T06:00:51.840 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T06:00:52.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T06:00:52.065 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:00:52.065 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T06:00:52.065 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T06:00:52.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T06:00:52.065 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:52.066 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T06:00:52.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803784 2026-02-13T06:00:52.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803784 2026-02-13T06:00:52.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784' 2026-02-13T06:00:52.129 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:52.129 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T06:00:52.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607559 2026-02-13T06:00:52.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607559 2026-02-13T06:00:52.195 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-51539607559' 2026-02-13T06:00:52.196 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:52.196 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T06:00:52.260 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561027 2026-02-13T06:00:52.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561027 2026-02-13T06:00:52.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-51539607559 2-188978561027' 2026-02-13T06:00:52.261 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:00:52.261 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T06:00:52.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116998 2026-02-13T06:00:52.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116998 2026-02-13T06:00:52.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-51539607559 2-188978561027 3-115964116998' 2026-02-13T06:00:52.323 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:52.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803784 2026-02-13T06:00:52.324 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:52.325 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T06:00:52.325 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803784 2026-02-13T06:00:52.325 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:52.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803784 2026-02-13T06:00:52.327 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803784' 2026-02-13T06:00:52.327 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803784 2026-02-13T06:00:52.327 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:00:52.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803784 -lt 25769803784 2026-02-13T06:00:52.552 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:52.553 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-51539607559 2026-02-13T06:00:52.553 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:52.554 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T06:00:52.555 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-51539607559 2026-02-13T06:00:52.555 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:52.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607559 2026-02-13T06:00:52.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 51539607559' 2026-02-13T06:00:52.556 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 51539607559 2026-02-13T06:00:52.557 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T06:00:52.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607559 -lt 51539607559 2026-02-13T06:00:52.792 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:52.793 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-188978561027 2026-02-13T06:00:52.793 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:52.794 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T06:00:52.795 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-188978561027 2026-02-13T06:00:52.795 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:52.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=188978561027 2026-02-13T06:00:52.796 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 188978561027' 2026-02-13T06:00:52.796 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 188978561027 2026-02-13T06:00:52.796 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T06:00:53.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 188978561027 2026-02-13T06:00:53.027 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T06:00:54.028 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T06:00:54.029 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T06:00:54.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 188978561027 2026-02-13T06:00:54.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T06:00:55.256 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T06:00:55.257 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T06:00:55.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 188978561027 -lt 188978561027 2026-02-13T06:00:55.485 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:00:55.486 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-115964116998 2026-02-13T06:00:55.486 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:00:55.487 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T06:00:55.487 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-115964116998 2026-02-13T06:00:55.488 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:00:55.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116998 2026-02-13T06:00:55.489 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 115964116998' 2026-02-13T06:00:55.489 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 115964116998 2026-02-13T06:00:55.489 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T06:00:55.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116999 -lt 115964116998 2026-02-13T06:00:55.719 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T06:00:55.720 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:00:55.720 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:00:56.032 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T06:00:56.033 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T06:00:56.033 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T06:00:56.034 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T06:00:56.034 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T06:00:56.034 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T06:00:56.034 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T06:00:56.034 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T06:00:56.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T06:00:56.269 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T06:00:56.270 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:00:56.270 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:00:56.584 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T06:00:56.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T06:00:56.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T06:00:56.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:360: TEST_rados_get_with_subreadall_eio_shard_0: delete_erasure_coded_pool pool-jerasure 2026-02-13T06:00:56.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T06:00:56.585 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T06:00:56.857 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T06:00:56.865 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T06:00:57.146 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T06:00:57.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T06:00:57.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T06:00:57.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T06:00:57.154 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T06:00:57.155 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T06:00:57.155 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T06:00:57.155 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T06:00:57.156 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T06:00:57.156 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T06:00:57.264 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T06:00:57.265 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T06:00:57.266 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T06:00:57.266 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T06:00:57.268 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T06:00:57.268 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T06:00:57.268 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T06:00:57.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:00:57.269 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T06:00:57.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T06:00:57.270 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:00:57.270 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T06:00:57.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T06:00:57.271 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T06:00:57.282 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T06:00:57.282 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:57.282 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:57.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T06:00:57.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T06:00:57.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T06:00:57.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-13T06:00:57.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-13T06:00:57.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/test-erasure-eio 2026-02-13T06:00:57.284 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/test-erasure-eio 2026-02-13T06:00:57.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T06:00:57.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T06:00:57.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T06:00:57.285 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T06:00:57.285 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T06:00:57.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T06:00:57.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T06:00:57.285 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T06:00:57.286 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T06:00:57.286 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T06:00:57.287 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T06:00:57.287 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T06:00:57.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T06:00:57.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T06:00:57.288 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T06:00:57.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:00:57.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T06:00:57.290 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T06:00:57.290 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:00:57.290 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T06:00:57.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T06:00:57.291 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T06:00:57.292 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T06:00:57.292 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:57.293 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:57.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T06:00:57.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T06:00:57.293 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T06:00:57.294 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/test-erasure-eio 2026-02-13T06:00:57.295 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T06:00:57.295 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:57.295 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:57.295 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72120 2026-02-13T06:00:57.296 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T06:00:57.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T06:00:57.297 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T06:00:57.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-13T06:00:57.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-13T06:00:57.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/test-erasure-eio 2026-02-13T06:00:57.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T06:00:57.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T06:00:57.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T06:00:57.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/test-erasure-eio/a 2026-02-13T06:00:57.298 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-13T06:00:57.318 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T06:00:57.319 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:57.319 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:57.319 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:57.319 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:57.319 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:57.319 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:57.319 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T06:00:57.344 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T06:00:57.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T06:00:57.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T06:00:57.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T06:00:57.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T06:00:57.345 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T06:00:57.347 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T06:00:57.347 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T06:00:57.347 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T06:00:57.347 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:57.347 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:57.347 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:57.347 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T06:00:57.347 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T06:00:57.347 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get fsid 2026-02-13T06:00:57.391 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T06:00:57.391 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T06:00:57.391 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T06:00:57.392 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T06:00:57.392 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T06:00:57.393 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T06:00:57.393 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T06:00:57.393 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T06:00:57.393 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:57.393 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:57.393 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:57.393 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T06:00:57.394 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T06:00:57.394 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72120/ceph-mon.a.asok config get mon_host 2026-02-13T06:00:57.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-13T06:00:57.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/test-erasure-eio 2026-02-13T06:00:57.438 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T06:00:57.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T06:00:57.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T06:00:57.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/test-erasure-eio/x 2026-02-13T06:00:57.439 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T06:00:57.537 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T06:00:57.537 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:57.537 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:57.537 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:57.537 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:57.537 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:57.537 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:57.538 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T06:00:57.538 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T06:00:57.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-13T06:00:57.556 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-13T06:00:57.654 INFO:tasks.workunit.client.0.trial024.stderr:pool 'rbd' already exists 2026-02-13T06:00:57.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T06:00:58.663 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-13T06:00:58.663 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T06:00:58.663 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T06:00:58.664 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:00:58.664 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:58.664 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:58.664 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-mon.a.asok 2026-02-13T06:00:58.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-13T06:00:58.664 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-mon.a.asok log flush 2026-02-13T06:00:58.705 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T06:00:58.710 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-13T06:00:58.711 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T06:00:57.337+0000 7f23b4e15d80 0 load: jerasure load: lrc 2026-02-13T06:00:58.712 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_with_subreadall_eio_shard_1 td/test-erasure-eio 2026-02-13T06:00:58.712 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:364: TEST_rados_get_with_subreadall_eio_shard_1: local dir=td/test-erasure-eio 2026-02-13T06:00:58.713 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:365: TEST_rados_get_with_subreadall_eio_shard_1: local shard_id=1 2026-02-13T06:00:58.713 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:367: TEST_rados_get_with_subreadall_eio_shard_1: setup_osds 4 2026-02-13T06:00:58.713 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-13T06:00:58.713 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-13T06:00:58.713 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-13T06:00:58.713 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-13T06:00:58.717 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T06:00:58.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-13T06:00:58.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T06:00:58.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T06:00:58.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T06:00:58.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T06:00:58.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-13T06:00:58.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:00:58.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:00:58.718 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:00:58.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:00:58.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-13T06:00:58.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-13T06:00:58.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T06:00:58.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T06:00:58.719 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:00:58.719 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T06:00:58.719 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:00:58.719 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:00:58.719 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:00:58.719 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:00:58.719 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:00:58.720 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:58.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:00:58.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:00:58.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T06:00:58.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T06:00:58.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:00:58.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:00:58.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:00:58.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:00:58.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:00:58.720 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:00:58.721 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T06:00:58.721 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T06:00:58.721 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-13T06:00:58.721 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T06:00:58.721 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=49955766-e800-47ca-9013-7056b0d243db 2026-02-13T06:00:58.721 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 49955766-e800-47ca-9013-7056b0d243db' 2026-02-13T06:00:58.721 INFO:tasks.workunit.client.0.trial024.stdout:add osd0 49955766-e800-47ca-9013-7056b0d243db 2026-02-13T06:00:58.722 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T06:00:58.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAavo5p1nR3KxAAyd/RF46a4dssenQrdr74DA== 2026-02-13T06:00:58.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAavo5p1nR3KxAAyd/RF46a4dssenQrdr74DA=="}' 2026-02-13T06:00:58.730 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 49955766-e800-47ca-9013-7056b0d243db -i td/test-erasure-eio/0/new.json 2026-02-13T06:00:58.835 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:58.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-13T06:00:58.843 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAavo5p1nR3KxAAyd/RF46a4dssenQrdr74DA== --osd-uuid 49955766-e800-47ca-9013-7056b0d243db 2026-02-13T06:00:58.861 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:58.860+0000 7fcd60581900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:58.862 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:58.861+0000 7fcd60581900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:58.863 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:58.863+0000 7fcd60581900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:58.864 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:58.863+0000 7fcd60581900 -1 bdev(0x5576515b2c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-13T06:00:58.864 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:58.863+0000 7fcd60581900 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-13T06:00:59.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-13T06:00:59.273 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T06:00:59.274 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T06:00:59.275 INFO:tasks.workunit.client.0.trial024.stdout:adding osd0 key to auth repository 2026-02-13T06:00:59.275 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T06:00:59.378 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T06:00:59.378 INFO:tasks.workunit.client.0.trial024.stdout:start osd.0 2026-02-13T06:00:59.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:00:59.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T06:00:59.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T06:00:59.379 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T06:00:59.395 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:59.395+0000 7f6684f5d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:59.397 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:59.396+0000 7f6684f5d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:59.397 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:59.397+0000 7f6684f5d900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:00:59.476 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T06:00:59.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:00:59.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T06:00:59.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:00:59.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:00:59.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:00:59.477 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:00:59.477 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:00:59.478 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:00:59.478 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T06:00:59.577 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:00:59.608 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:59.607+0000 7f6684f5d900 -1 Falling back to public interface 2026-02-13T06:00:59.881 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:00:59.880+0000 7f6684f5d900 -1 osd.0 0 log_to_monitors true 2026-02-13T06:01:00.578 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:01:00.578 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:01:00.579 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:01:00.579 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:01:00.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:01:00.580 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T06:01:00.806 INFO:tasks.workunit.client.0.trial024.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1558035735,v1:127.0.0.1:6803/1558035735] [v2:127.0.0.1:6804/1558035735,v1:127.0.0.1:6805/1558035735] exists,up 49955766-e800-47ca-9013-7056b0d243db 2026-02-13T06:01:00.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:01:00.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:01:00.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:01:00.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T06:01:00.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-13T06:01:00.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T06:01:00.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T06:01:00.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T06:01:00.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T06:01:00.810 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-13T06:01:00.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:01:00.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:01:00.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:01:00.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:01:00.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-13T06:01:00.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-13T06:01:00.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T06:01:00.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T06:01:00.811 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:01:00.811 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T06:01:00.811 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:01:00.811 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:01:00.812 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:01:00.812 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:01:00.812 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:01:00.812 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:01:00.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:01:00.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:01:00.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T06:01:00.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T06:01:00.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:01:00.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:01:00.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:01:00.812 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:01:00.813 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:01:00.813 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:01:00.813 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T06:01:00.813 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T06:01:00.813 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-13T06:01:00.813 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T06:01:00.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=423807aa-e5e4-4934-8840-25a554a3e976 2026-02-13T06:01:00.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 423807aa-e5e4-4934-8840-25a554a3e976' 2026-02-13T06:01:00.814 INFO:tasks.workunit.client.0.trial024.stdout:add osd1 423807aa-e5e4-4934-8840-25a554a3e976 2026-02-13T06:01:00.814 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T06:01:00.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAcvo5pQM//MBAAuEiMydwGNyTR0Oyy8KhgTQ== 2026-02-13T06:01:00.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAcvo5pQM//MBAAuEiMydwGNyTR0Oyy8KhgTQ=="}' 2026-02-13T06:01:00.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 423807aa-e5e4-4934-8840-25a554a3e976 -i td/test-erasure-eio/1/new.json 2026-02-13T06:01:01.053 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:01:01.061 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-13T06:01:01.062 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAcvo5pQM//MBAAuEiMydwGNyTR0Oyy8KhgTQ== --osd-uuid 423807aa-e5e4-4934-8840-25a554a3e976 2026-02-13T06:01:01.080 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:01.079+0000 7f2759862900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:01.081 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:01.081+0000 7f2759862900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:01.082 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:01.082+0000 7f2759862900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:01.083 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:01.082+0000 7f2759862900 -1 bdev(0x55a08640ec00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-13T06:01:01.083 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:01.082+0000 7f2759862900 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-13T06:01:01.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-13T06:01:01.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T06:01:01.413 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T06:01:01.413 INFO:tasks.workunit.client.0.trial024.stdout:adding osd1 key to auth repository 2026-02-13T06:01:01.414 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T06:01:01.731 INFO:tasks.workunit.client.0.trial024.stdout:start osd.1 2026-02-13T06:01:01.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T06:01:01.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:01:01.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T06:01:01.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T06:01:01.732 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T06:01:01.749 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:01.748+0000 7f155d4ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:01.750 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:01.749+0000 7f155d4ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:01.751 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:01.750+0000 7f155d4ba900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:01.896 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:01.896+0000 7f155d4ba900 -1 Falling back to public interface 2026-02-13T06:01:01.955 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T06:01:01.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:01:01.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T06:01:01.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:01:01.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:01:01.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:01:01.956 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:01:01.956 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:01:01.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:01:01.957 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T06:01:02.180 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:01:02.257 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:02.256+0000 7f155d4ba900 -1 osd.1 0 log_to_monitors true 2026-02-13T06:01:03.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:01:03.182 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:01:03.182 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:01:03.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:01:03.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:01:03.183 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T06:01:03.404 INFO:tasks.workunit.client.0.trial024.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/635630177,v1:127.0.0.1:6811/635630177] [v2:127.0.0.1:6812/635630177,v1:127.0.0.1:6813/635630177] exists,up 423807aa-e5e4-4934-8840-25a554a3e976 2026-02-13T06:01:03.407 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:01:03.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:01:03.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:01:03.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T06:01:03.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-13T06:01:03.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T06:01:03.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T06:01:03.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T06:01:03.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T06:01:03.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T06:01:03.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:01:03.408 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:01:03.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:01:03.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:01:03.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T06:01:03.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T06:01:03.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T06:01:03.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T06:01:03.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:01:03.409 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T06:01:03.409 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:01:03.409 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:01:03.409 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:01:03.409 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:01:03.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T06:01:03.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T06:01:03.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T06:01:03.411 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T06:01:03.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=29166b36-d7c3-4ed7-9987-f1841c36c8bd 2026-02-13T06:01:03.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 29166b36-d7c3-4ed7-9987-f1841c36c8bd' 2026-02-13T06:01:03.412 INFO:tasks.workunit.client.0.trial024.stdout:add osd2 29166b36-d7c3-4ed7-9987-f1841c36c8bd 2026-02-13T06:01:03.412 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T06:01:03.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAfvo5p6kIEGRAANDVdO1rFb0keSWnMBO+GaQ== 2026-02-13T06:01:03.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAfvo5p6kIEGRAANDVdO1rFb0keSWnMBO+GaQ=="}' 2026-02-13T06:01:03.420 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 29166b36-d7c3-4ed7-9987-f1841c36c8bd -i td/test-erasure-eio/2/new.json 2026-02-13T06:01:03.647 INFO:tasks.workunit.client.0.trial024.stdout:2 2026-02-13T06:01:03.655 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-13T06:01:03.656 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAfvo5p6kIEGRAANDVdO1rFb0keSWnMBO+GaQ== --osd-uuid 29166b36-d7c3-4ed7-9987-f1841c36c8bd 2026-02-13T06:01:03.673 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:03.673+0000 7fbcb3e22900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:03.675 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:03.674+0000 7fbcb3e22900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:03.676 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:03.675+0000 7fbcb3e22900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:03.676 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:03.676+0000 7fbcb3e22900 -1 bdev(0x557d1cf70c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-13T06:01:03.676 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:03.676+0000 7fbcb3e22900 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-13T06:01:03.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-13T06:01:03.995 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T06:01:03.996 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T06:01:03.997 INFO:tasks.workunit.client.0.trial024.stdout:adding osd2 key to auth repository 2026-02-13T06:01:03.997 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T06:01:04.324 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T06:01:04.325 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T06:01:04.325 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:01:04.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T06:01:04.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T06:01:04.326 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T06:01:04.342 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:04.341+0000 7ff81434f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:04.343 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:04.343+0000 7ff81434f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:04.344 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:04.344+0000 7ff81434f900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:04.471 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:04.470+0000 7ff81434f900 -1 Falling back to public interface 2026-02-13T06:01:04.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T06:01:04.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:01:04.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T06:01:04.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:01:04.547 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:01:04.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:01:04.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:01:04.548 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:01:04.548 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:01:04.549 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T06:01:04.778 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:01:04.833 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:04.832+0000 7ff81434f900 -1 osd.2 0 log_to_monitors true 2026-02-13T06:01:05.779 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:01:05.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:01:05.780 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:01:05.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:01:05.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:01:05.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T06:01:06.003 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2285153547,v1:127.0.0.1:6819/2285153547] [v2:127.0.0.1:6820/2285153547,v1:127.0.0.1:6821/2285153547] exists,up 29166b36-d7c3-4ed7-9987-f1841c36c8bd 2026-02-13T06:01:06.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:01:06.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:01:06.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:01:06.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-13T06:01:06.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-13T06:01:06.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/test-erasure-eio 2026-02-13T06:01:06.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T06:01:06.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T06:01:06.007 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T06:01:06.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-13T06:01:06.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:01:06.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:01:06.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:01:06.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:01:06.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-13T06:01:06.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-13T06:01:06.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T06:01:06.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T06:01:06.008 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:01:06.008 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:01:06.009 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:01:06.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:01:06.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:01:06.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:01:06.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T06:01:06.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T06:01:06.010 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-13T06:01:06.010 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T06:01:06.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=74917c0c-9aa7-4ddc-abab-b45e6270d974 2026-02-13T06:01:06.011 INFO:tasks.workunit.client.0.trial024.stdout:add osd3 74917c0c-9aa7-4ddc-abab-b45e6270d974 2026-02-13T06:01:06.011 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 74917c0c-9aa7-4ddc-abab-b45e6270d974' 2026-02-13T06:01:06.011 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T06:01:06.020 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAivo5pYPEjARAACyySwXe9i5Ixc7+kHTIqNg== 2026-02-13T06:01:06.020 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAivo5pYPEjARAACyySwXe9i5Ixc7+kHTIqNg=="}' 2026-02-13T06:01:06.020 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 74917c0c-9aa7-4ddc-abab-b45e6270d974 -i td/test-erasure-eio/3/new.json 2026-02-13T06:01:06.246 INFO:tasks.workunit.client.0.trial024.stdout:3 2026-02-13T06:01:06.254 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-13T06:01:06.255 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAivo5pYPEjARAACyySwXe9i5Ixc7+kHTIqNg== --osd-uuid 74917c0c-9aa7-4ddc-abab-b45e6270d974 2026-02-13T06:01:06.274 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:06.272+0000 7f032b179900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:06.275 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:06.273+0000 7f032b179900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:06.276 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:06.274+0000 7f032b179900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:06.276 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:06.275+0000 7f032b179900 -1 bdev(0x55daba952c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-13T06:01:06.277 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:06.275+0000 7f032b179900 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-13T06:01:06.617 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-13T06:01:06.617 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T06:01:06.618 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T06:01:06.619 INFO:tasks.workunit.client.0.trial024.stdout:adding osd3 key to auth repository 2026-02-13T06:01:06.619 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T06:01:06.963 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T06:01:06.963 INFO:tasks.workunit.client.0.trial024.stdout:start osd.3 2026-02-13T06:01:06.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:01:06.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T06:01:06.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T06:01:06.964 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T06:01:06.981 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:06.979+0000 7f7862812900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:06.997 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:06.980+0000 7f7862812900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:06.997 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:06.981+0000 7f7862812900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:07.110 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:07.109+0000 7f7862812900 -1 Falling back to public interface 2026-02-13T06:01:07.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T06:01:07.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:01:07.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T06:01:07.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:01:07.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:01:07.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:01:07.188 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:01:07.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:01:07.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:01:07.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T06:01:07.409 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:01:07.492 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:07.490+0000 7f7862812900 -1 osd.3 0 log_to_monitors true 2026-02-13T06:01:08.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:01:08.410 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:01:08.411 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:01:08.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:01:08.411 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:01:08.412 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T06:01:08.632 INFO:tasks.workunit.client.0.trial024.stdout:osd.3 up in weight 1 up_from 26 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2750530388,v1:127.0.0.1:6827/2750530388] [v2:127.0.0.1:6828/2750530388,v1:127.0.0.1:6829/2750530388] exists,up 74917c0c-9aa7-4ddc-abab-b45e6270d974 2026-02-13T06:01:08.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:01:08.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:01:08.634 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:01:08.634 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-13T06:01:08.635 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T06:01:08.635 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T06:01:08.635 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:01:08.635 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:01:08.635 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:01:08.635 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.0.asok 2026-02-13T06:01:08.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-13T06:01:08.635 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.0.asok log flush 2026-02-13T06:01:08.681 INFO:tasks.workunit.client.0.trial024.stdout:{} 2026-02-13T06:01:08.686 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-13T06:01:08.688 INFO:tasks.workunit.client.0.trial024.stdout:2026-02-13T06:00:59.610+0000 7f6684f5d900 0 load: jerasure load: lrc 2026-02-13T06:01:08.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:369: TEST_rados_get_with_subreadall_eio_shard_1: local poolname=pool-jerasure 2026-02-13T06:01:08.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:370: TEST_rados_get_with_subreadall_eio_shard_1: create_erasure_coded_pool pool-jerasure 2 1 2026-02-13T06:01:08.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T06:01:08.690 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-13T06:01:08.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-13T06:01:08.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-13T06:01:08.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-13T06:01:08.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-13T06:01:08.691 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-13T06:01:08.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-13T06:01:08.974 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-13T06:01:09.346 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' already exists 2026-02-13T06:01:09.354 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T06:01:10.355 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-13T06:01:10.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T06:01:10.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T06:01:10.356 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T06:01:10.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T06:01:10.357 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T06:01:10.357 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T06:01:10.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T06:01:10.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T06:01:10.357 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T06:01:10.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T06:01:10.444 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T06:01:10.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T06:01:10.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T06:01:10.445 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T06:01:10.445 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T06:01:10.669 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T06:01:10.670 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:01:10.670 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T06:01:10.670 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T06:01:10.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T06:01:10.670 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:01:10.670 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T06:01:10.733 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803780 2026-02-13T06:01:10.733 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803780 2026-02-13T06:01:10.733 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780' 2026-02-13T06:01:10.733 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:01:10.733 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T06:01:10.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-13T06:01:10.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-13T06:01:10.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852' 2026-02-13T06:01:10.800 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:01:10.800 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T06:01:10.863 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411331 2026-02-13T06:01:10.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411331 2026-02-13T06:01:10.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852 2-77309411331' 2026-02-13T06:01:10.864 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:01:10.864 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T06:01:10.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149700 2026-02-13T06:01:10.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149700 2026-02-13T06:01:10.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803780 1-55834574852 2-77309411331 3-111669149700' 2026-02-13T06:01:10.931 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:01:10.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803780 2026-02-13T06:01:10.932 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:01:10.932 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T06:01:10.933 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803780 2026-02-13T06:01:10.933 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:01:10.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803780 2026-02-13T06:01:10.935 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803780' 2026-02-13T06:01:10.935 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803780 2026-02-13T06:01:10.935 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:01:11.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803778 -lt 25769803780 2026-02-13T06:01:11.168 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T06:01:12.169 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T06:01:12.170 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:01:12.395 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803781 -lt 25769803780 2026-02-13T06:01:12.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:01:12.396 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574852 2026-02-13T06:01:12.396 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:01:12.397 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T06:01:12.398 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574852 2026-02-13T06:01:12.398 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:01:12.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574852 2026-02-13T06:01:12.399 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574852' 2026-02-13T06:01:12.399 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 55834574852 2026-02-13T06:01:12.400 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T06:01:12.620 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-13T06:01:12.621 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:01:12.621 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-77309411331 2026-02-13T06:01:12.621 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:01:12.622 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T06:01:12.623 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-77309411331 2026-02-13T06:01:12.623 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:01:12.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=77309411331 2026-02-13T06:01:12.624 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 77309411331' 2026-02-13T06:01:12.625 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 77309411331 2026-02-13T06:01:12.625 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T06:01:12.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 77309411332 -lt 77309411331 2026-02-13T06:01:12.846 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:01:12.847 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149700 2026-02-13T06:01:12.847 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:01:12.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T06:01:12.848 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149700 2026-02-13T06:01:12.849 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:01:12.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149700 2026-02-13T06:01:12.850 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149700' 2026-02-13T06:01:12.850 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 111669149700 2026-02-13T06:01:12.851 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T06:01:13.076 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149700 -lt 111669149700 2026-02-13T06:01:13.077 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T06:01:13.077 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:01:13.077 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:01:13.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T06:01:13.396 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T06:01:13.396 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T06:01:13.397 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T06:01:13.397 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T06:01:13.397 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T06:01:13.397 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T06:01:13.397 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T06:01:13.626 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T06:01:13.626 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T06:01:13.626 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:01:13.627 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:01:13.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T06:01:13.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T06:01:13.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T06:01:13.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:372: TEST_rados_get_with_subreadall_eio_shard_1: rados_put_get_data eio td/test-erasure-eio 1 recovery 2026-02-13T06:01:13.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=eio 2026-02-13T06:01:13.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-13T06:01:13.940 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-13T06:01:13.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-13T06:01:13.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=1 2026-02-13T06:01:13.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-13T06:01:13.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg=recovery 2026-02-13T06:01:13.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-13T06:01:13.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-eio-72120-1 2026-02-13T06:01:13.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-eio-72120-1 2026-02-13T06:01:13.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-13T06:01:13.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-13T06:01:13.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-eio-72120-1 2026-02-13T06:01:13.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:01:13.941 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-13T06:01:13.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:01:13.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-13T06:01:13.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:01:13.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-13T06:01:13.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-13T06:01:13.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-13T06:01:13.942 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-eio-72120-1 td/test-erasure-eio/ORIGINAL 2026-02-13T06:01:13.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-72120-1 td/test-erasure-eio 1 2026-02-13T06:01:13.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=ec 2026-02-13T06:01:13.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T06:01:13.959 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=pool-jerasure 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=obj-eio-72120-1 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/test-erasure-eio 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=1 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds pool-jerasure obj-eio-72120-1 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72120-1 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72120-1 2026-02-13T06:01:13.960 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T06:01:14.187 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T06:01:14.187 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:01:14.187 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T06:01:14.187 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T06:01:14.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('3' '1' '2') 2026-02-13T06:01:14.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T06:01:14.187 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-13T06:01:14.188 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' ec '!=' ec ']' 2026-02-13T06:01:14.188 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/test-erasure-eio/1/type 2026-02-13T06:01:14.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T06:01:14.189 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-13T06:01:14.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T06:01:14.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-13T06:01:14.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T06:01:14.190 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T06:01:14.190 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T06:01:14.190 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-13T06:01:14.190 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T06:01:14.190 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T06:01:14.190 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:01:14.190 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:01:14.190 INFO:tasks.workunit.client.0.trial024.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:01:14.191 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.1.asok 2026-02-13T06:01:14.191 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.72120/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-13T06:01:14.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T06:01:14.239 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T06:01:14.240 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T06:01:14.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-13T06:01:14.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T06:01:14.240 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T06:01:14.241 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T06:01:14.241 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:01:14.241 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:01:14.241 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72120/ceph-osd.1.asok 2026-02-13T06:01:14.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T06:01:14.241 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.72120/ceph-osd.1.asok injectdataerr pool-jerasure obj-eio-72120-1 1 2026-02-13T06:01:14.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-72120-1 2026-02-13T06:01:14.288 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-13T06:01:14.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-13T06:01:14.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-72120-1 2026-02-13T06:01:14.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-13T06:01:14.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-13T06:01:14.289 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-72120-1 td/test-erasure-eio/COPY 2026-02-13T06:01:14.307 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-13T06:01:14.308 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-13T06:01:14.309 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' recovery = recovery ']' 2026-02-13T06:01:14.310 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: get_osds pool-jerasure obj-eio-72120-1 2026-02-13T06:01:14.310 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T06:01:14.310 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72120-1 2026-02-13T06:01:14.310 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72120-1 2026-02-13T06:01:14.310 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T06:01:14.540 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T06:01:14.540 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:01:14.540 INFO:tasks.workunit.client.0.trial024.stderr:2' 2026-02-13T06:01:14.540 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 2026-02-13T06:01:14.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: initial_osds=('3' '1' '2') 2026-02-13T06:01:14.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: local -a initial_osds 2026-02-13T06:01:14.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:171: rados_put_get_data: local last_osd=2 2026-02-13T06:01:14.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:173: rados_put_get_data: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-13T06:01:14.541 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T06:01:14.541 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T06:01:14.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T06:01:14.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T06:01:14.541 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T06:01:14.847 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T06:01:14.848 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:174: rados_put_get_data: ceph osd out 2 2026-02-13T06:01:15.128 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 is already out. 2026-02-13T06:01:15.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:175: rados_put_get_data: get_osds pool-jerasure obj-eio-72120-1 2026-02-13T06:01:15.137 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:175: rados_put_get_data: grep '\<2\>' 2026-02-13T06:01:15.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=pool-jerasure 2026-02-13T06:01:15.138 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj-eio-72120-1 2026-02-13T06:01:15.138 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map pool-jerasure obj-eio-72120-1 2026-02-13T06:01:15.138 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T06:01:15.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-13T06:01:15.367 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:01:15.367 INFO:tasks.workunit.client.0.trial024.stderr:0' 2026-02-13T06:01:15.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 0 2026-02-13T06:01:15.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:176: rados_put_get_data: ceph osd in 2 2026-02-13T06:01:15.645 INFO:tasks.workunit.client.0.trial024.stderr:osd.2 is already in. 2026-02-13T06:01:15.658 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:177: rados_put_get_data: activate_osd td/test-erasure-eio 2 2026-02-13T06:01:15.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/test-erasure-eio 2026-02-13T06:01:15.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T06:01:15.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T06:01:15.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T06:01:15.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-13T06:01:15.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-13T06:01:15.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T06:01:15.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T06:01:15.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T06:01:15.659 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-13T06:01:15.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-13T06:01:15.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T06:01:15.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T06:01:15.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-13T06:01:15.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T06:01:15.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T06:01:15.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T06:01:15.660 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T06:01:15.660 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:01:15.660 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:01:15.660 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:01:15.660 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' 2026-02-13T06:01:15.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T06:01:15.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-13T06:01:15.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-13T06:01:15.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T06:01:15.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T06:01:15.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T06:01:15.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T06:01:15.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T06:01:15.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T06:01:15.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-13T06:01:15.661 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T06:01:15.662 INFO:tasks.workunit.client.0.trial024.stdout:start osd.2 2026-02-13T06:01:15.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=5c7b2499-2e95-468a-9f9e-7dca5fd9ecd0 --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.72120/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T06:01:15.663 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-13T06:01:15.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T06:01:15.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T06:01:15.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T06:01:15.663 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T06:01:15.674 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:15.672+0000 7f5f89f88900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:15.676 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:15.674+0000 7f5f89f88900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:15.676 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:15.675+0000 7f5f89f88900 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T06:01:15.839 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:15.838+0000 7f5f89f88900 -1 Falling back to public interface 2026-02-13T06:01:15.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T06:01:15.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T06:01:15.887 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T06:01:15.888 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T06:01:15.888 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T06:01:15.888 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:01:15.888 INFO:tasks.workunit.client.0.trial024.stdout:0 2026-02-13T06:01:15.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T06:01:15.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:01:15.889 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T06:01:16.110 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T06:01:16.225 INFO:tasks.workunit.client.0.trial024.stderr:2026-02-13T06:01:16.223+0000 7f5f89f88900 -1 osd.2 34 log_to_monitors true 2026-02-13T06:01:17.111 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T06:01:17.112 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T06:01:17.112 INFO:tasks.workunit.client.0.trial024.stdout:1 2026-02-13T06:01:17.113 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T06:01:17.113 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T06:01:17.113 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T06:01:17.334 INFO:tasks.workunit.client.0.trial024.stdout:osd.2 up in weight 1 up_from 43 up_thru 20 down_at 35 last_clean_interval [18,34) [v2:127.0.0.1:6818/4097911010,v1:127.0.0.1:6819/4097911010] [v2:127.0.0.1:6820/4097911010,v1:127.0.0.1:6821/4097911010] exists,up 29166b36-d7c3-4ed7-9987-f1841c36c8bd 2026-02-13T06:01:17.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T06:01:17.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T06:01:17.335 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T06:01:17.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:178: rados_put_get_data: wait_for_clean 2026-02-13T06:01:17.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T06:01:17.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T06:01:17.336 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T06:01:17.336 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T06:01:17.336 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T06:01:17.336 INFO:tasks.workunit.client.0.trial024.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T06:01:17.336 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T06:01:17.336 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T06:01:17.336 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T06:01:17.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T06:01:17.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T06:01:17.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T06:01:17.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T06:01:17.422 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T06:01:17.423 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T06:01:17.650 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T06:01:17.650 INFO:tasks.workunit.client.0.trial024.stderr:1 2026-02-13T06:01:17.650 INFO:tasks.workunit.client.0.trial024.stderr:2 2026-02-13T06:01:17.650 INFO:tasks.workunit.client.0.trial024.stderr:3' 2026-02-13T06:01:17.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T06:01:17.651 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:01:17.651 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T06:01:17.715 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=25769803784 2026-02-13T06:01:17.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 25769803784 2026-02-13T06:01:17.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784' 2026-02-13T06:01:17.716 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:01:17.716 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T06:01:17.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574855 2026-02-13T06:01:17.780 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574855 2026-02-13T06:01:17.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-55834574855' 2026-02-13T06:01:17.781 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:01:17.781 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T06:01:17.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593731 2026-02-13T06:01:17.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593731 2026-02-13T06:01:17.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-55834574855 2-184683593731' 2026-02-13T06:01:17.845 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T06:01:17.845 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T06:01:17.910 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149703 2026-02-13T06:01:17.910 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149703 2026-02-13T06:01:17.910 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-25769803784 1-55834574855 2-184683593731 3-111669149703' 2026-02-13T06:01:17.910 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:01:17.910 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-25769803784 2026-02-13T06:01:17.911 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:01:17.911 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T06:01:17.912 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-25769803784 2026-02-13T06:01:17.912 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:01:17.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=25769803784 2026-02-13T06:01:17.913 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 25769803784' 2026-02-13T06:01:17.913 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.0 seq 25769803784 2026-02-13T06:01:17.914 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:01:18.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803784 2026-02-13T06:01:18.135 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T06:01:19.136 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T06:01:19.137 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:01:19.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803782 -lt 25769803784 2026-02-13T06:01:19.367 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T06:01:20.369 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T06:01:20.370 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T06:01:20.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 25769803784 -lt 25769803784 2026-02-13T06:01:20.595 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:01:20.595 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-55834574855 2026-02-13T06:01:20.596 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:01:20.596 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T06:01:20.597 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-55834574855 2026-02-13T06:01:20.597 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:01:20.598 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574855 2026-02-13T06:01:20.598 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 55834574855' 2026-02-13T06:01:20.599 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.1 seq 55834574855 2026-02-13T06:01:20.599 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T06:01:20.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574856 -lt 55834574855 2026-02-13T06:01:20.823 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:01:20.823 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-184683593731 2026-02-13T06:01:20.823 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:01:20.824 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T06:01:20.825 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-184683593731 2026-02-13T06:01:20.825 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:01:20.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=184683593731 2026-02-13T06:01:20.826 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 184683593731' 2026-02-13T06:01:20.826 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.2 seq 184683593731 2026-02-13T06:01:20.827 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T06:01:21.055 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 184683593731 -lt 184683593731 2026-02-13T06:01:21.056 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T06:01:21.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-111669149703 2026-02-13T06:01:21.056 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T06:01:21.057 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T06:01:21.058 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-111669149703 2026-02-13T06:01:21.058 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T06:01:21.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149703 2026-02-13T06:01:21.059 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 111669149703' 2026-02-13T06:01:21.059 INFO:tasks.workunit.client.0.trial024.stdout:waiting osd.3 seq 111669149703 2026-02-13T06:01:21.059 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T06:01:21.282 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149704 -lt 111669149703 2026-02-13T06:01:21.283 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T06:01:21.283 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:01:21.284 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:01:21.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-13T06:01:21.599 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T06:01:21.600 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T06:01:21.601 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T06:01:21.601 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T06:01:21.601 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T06:01:21.601 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T06:01:21.601 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T06:01:21.822 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-13T06:01:21.822 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T06:01:21.823 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T06:01:21.823 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T06:01:22.143 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-13T06:01:22.144 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T06:01:22.144 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T06:01:22.144 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:374: TEST_rados_get_with_subreadall_eio_shard_1: delete_erasure_coded_pool pool-jerasure 2026-02-13T06:01:22.144 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-13T06:01:22.144 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-13T06:01:22.413 INFO:tasks.workunit.client.0.trial024.stderr:pool 'pool-jerasure' does not exist 2026-02-13T06:01:22.421 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-13T06:01:22.696 INFO:tasks.workunit.client.0.trial024.stderr:erasure-code-profile myprofile does not exist 2026-02-13T06:01:22.705 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-13T06:01:22.705 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T06:01:22.705 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T06:01:22.705 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T06:01:22.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T06:01:22.705 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T06:01:22.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T06:01:22.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T06:01:22.706 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T06:01:22.814 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T06:01:22.814 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T06:01:22.815 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T06:01:22.815 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T06:01:22.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T06:01:22.816 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T06:01:22.817 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T06:01:22.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:01:22.817 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T06:01:22.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T06:01:22.818 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:01:22.818 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T06:01:22.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T06:01:22.819 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T06:01:22.829 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T06:01:22.829 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:01:22.830 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:01:22.830 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T06:01:22.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T06:01:22.831 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T06:01:22.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-13T06:01:22.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/test-erasure-eio 0 2026-02-13T06:01:22.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/test-erasure-eio 2026-02-13T06:01:22.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-13T06:01:22.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-13T06:01:22.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T06:01:22.832 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T06:01:22.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T06:01:22.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T06:01:22.832 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T06:01:22.833 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T06:01:22.833 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T06:01:22.834 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T06:01:22.834 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T06:01:22.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T06:01:22.835 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T06:01:22.836 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T06:01:22.836 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:01:22.837 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T06:01:22.837 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T06:01:22.837 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T06:01:22.838 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T06:01:22.839 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-13T06:01:22.839 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/test-erasure-eio 2026-02-13T06:01:22.840 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T06:01:22.840 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T06:01:22.840 INFO:tasks.workunit.client.0.trial024.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72120 2026-02-13T06:01:22.840 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72120 2026-02-13T06:01:22.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T06:01:22.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T06:01:22.842 INFO:tasks.workunit.client.0.trial024.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-13T06:01:22.843 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-13T06:01:22.843 DEBUG:teuthology.orchestra.run.trial024:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T06:01:22.911 INFO:tasks.workunit:Stopping ['erasure-code'] on client.0... 2026-02-13T06:01:22.912 DEBUG:teuthology.orchestra.run.trial024:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-13T06:01:23.272 DEBUG:teuthology.parallel:result is None 2026-02-13T06:01:23.272 DEBUG:teuthology.orchestra.run.trial024:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-13T06:01:23.297 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-13T06:01:23.297 DEBUG:teuthology.orchestra.run.trial024:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-13T06:01:23.353 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-13T06:01:23.353 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T06:01:23.371 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T06:01:23.372 DEBUG:teuthology.orchestra.run.trial024:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T06:01:23.521 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T06:01:23.532 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T06:01:23.533 DEBUG:teuthology.orchestra.run.trial024:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T06:01:23.549 INFO:teuthology.orchestra.run.trial024.stderr:bash: line 1: ntpq: command not found 2026-02-13T06:01:23.570 INFO:teuthology.orchestra.run.trial024.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T06:01:23.570 INFO:teuthology.orchestra.run.trial024.stdout:=============================================================================== 2026-02-13T06:01:23.570 INFO:teuthology.orchestra.run.trial024.stdout:^+ kc1cloud.147.72.155.23.m> 3 6 377 39 -660us[ -660us] +/- 49ms 2026-02-13T06:01:23.571 INFO:teuthology.orchestra.run.trial024.stdout:^* ns1.smatwebdesign.com 3 6 377 43 -136us[ -116us] +/- 32ms 2026-02-13T06:01:23.571 INFO:teuthology.orchestra.run.trial024.stdout:^- ip216-250-115-174.pbiaas> 2 6 377 39 +1212us[+1212us] +/- 98ms 2026-02-13T06:01:23.571 INFO:teuthology.orchestra.run.trial024.stdout:^+ wdc1.us.ntp.li 3 6 377 39 +457us[ +457us] +/- 29ms 2026-02-13T06:01:23.572 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T06:01:23.587 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T06:01:23.587 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T06:01:23.601 DEBUG:teuthology.orchestra.run.trial024:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T06:01:23.653 DEBUG:teuthology.orchestra.run.trial024:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-13T06:01:23.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T06:01:23.719 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T06:01:23.734 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T06:01:23.748 INFO:teuthology.task.internal:Duration was 896.866787 seconds 2026-02-13T06:01:23.749 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T06:01:23.772 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T06:01:23.772 DEBUG:teuthology.orchestra.run.trial024:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T06:01:23.809 INFO:teuthology.orchestra.run.trial024.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T06:01:24.141 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T06:01:24.141 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial024.front.sepia.ceph.com 2026-02-13T06:01:24.141 DEBUG:teuthology.orchestra.run.trial024:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T06:01:24.199 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T06:01:24.199 DEBUG:teuthology.orchestra.run.trial024:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T06:01:24.279 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T06:01:24.279 DEBUG:teuthology.orchestra.run.trial024:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T06:01:24.341 INFO:teuthology.orchestra.run.trial024.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T06:01:24.342 INFO:teuthology.orchestra.run.trial024.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T06:01:24.342 INFO:teuthology.orchestra.run.trial024.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T06:01:24.342 INFO:teuthology.orchestra.run.trial024.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T06:01:24.342 INFO:teuthology.orchestra.run.trial024.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T06:01:24.345 INFO:teuthology.orchestra.run.trial024.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 86.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T06:01:24.347 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T06:01:24.363 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T06:01:24.364 DEBUG:teuthology.orchestra.run.trial024:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T06:01:24.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T06:01:24.428 DEBUG:teuthology.orchestra.run.trial024:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T06:01:24.475 INFO:teuthology.orchestra.run.trial024.stdout:kernel.core_pattern = core 2026-02-13T06:01:24.485 DEBUG:teuthology.orchestra.run.trial024:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T06:01:24.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T06:01:24.541 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T06:01:24.557 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T06:01:24.560 DEBUG:teuthology.misc:Transferring archived files from trial024:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47773/remote/trial024 2026-02-13T06:01:24.562 DEBUG:teuthology.orchestra.run.trial024:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T06:01:24.616 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T06:01:24.617 DEBUG:teuthology.orchestra.run.trial024:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T06:01:24.665 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T06:01:24.683 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T06:01:24.683 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T06:01:24.700 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T06:01:24.700 DEBUG:teuthology.orchestra.run.trial024:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T06:01:24.723 INFO:teuthology.orchestra.run.trial024.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 06:01 /home/ubuntu/cephtest 2026-02-13T06:01:24.724 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T06:01:24.741 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T06:01:24.779 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/erasure-code} duration: 896.8667871952057 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-13T06:01:24.779 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T06:01:24.909 INFO:teuthology.run:pass